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input signal having a plurality of input channels, to an output signal having a plurality of output channels. Mix coefficients may be 
generated responsive to a comparison of energy between the dowmixed (output) signal and the input signal to the dowmixer. such 
that energy and intended direction of the input signal are substantially preserved in the output signal. Further, or in the alternative, the 
mix coefficient generation may preserve an intended direction of an input signal, for example, received at a surround input channel, 
in at least one output channel of the output signal. The mix coe&lcient values may be generated in a test downmixer environment 
Additionally, one or more mix coefficients may be generated by retrieving predetermined mix coefficient values. Additionally, or in 
the alternative, one or more mix coefficients may be generated responsive to an input energy of a plurality of the input channels. 
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MULTICHANNEL DOWNMDONG DEVICE 

5 Inventor: 

David H. Griesinger 



Background Of The Invention 

1. Technical Field. 

10 [01] This application claims priority to U.S. Provisional Application No. 

60/377,661, attorney docket number 1 1336/137, entitled "A Multichannel To Two Channel 
Mixing Device And Method," by David H. Griesinger, filed May 3, 2002, and is hereby 
incorporated by reference. 

2. Related Art. 

15 [02] The invention relates to a mixing device, and more specifically, to a 

downmixer capable of mixing a multichannel signal including a plurality of channels to an 
output signal including a plurality of channels, while preserving the intended direction and 
signal energy of the multichannel signal. 

[03] Often, audio recordings, or movie soundtracks (film mixes), are created with 

20 more than two audio channels, to give a listener a more realistic feeling that the audio 

recording is live. For example, film mixes may be created as 3 channel recordings, providing 
left front (LF), right front (RF) and center (C) channels. Film mixes may instead be created 
as 5 channel recordings, including the LF, RF and C channels, along with rear left (RL) and 
rear right (RR) channels, or in some circumstances, as 5.1 channel recordings including the 

25 channels of the 5 channel recording plus a low frequency (LFE) channel. 

[04] However, the listener of the audio recording or film mix may have an audio 
system that supports less channels than the number of channels in which the audio recording 
or film mix has been created. Typically, this occurs when the listener's audio system 
supports only 2 channel (i.e., stereo) playback. In this circumstance, such recordings are 
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provided to a listener as a 2 channel recording by utilizing a combiner (downmixer) to 
combine, or downmix, the multichannel signal to 2 channels. The downmbcing may occur at 
an encoder^ for example, where a 2 channel recording is provided on the media (i.e., CD, 
DVD, etc.). The downmixing may occur at a decoder of the listener's audio system where 
5 the decoder downmbces the multichannel signal to the 2 channel mix. 

[OS] When downmixing a multichannel signal to 2 channels, downmixers typically 
employ fixed mix coefficients. A common downmixer used for 5 channel film recordings 
mixes the two rear channels together before mixing them in antiphase to the output channels. 
This may cause any signal in the rear channels to reproduce fi-om the rear in standard film 
10 decoders. However, information about whether the sound was fi-om the left rear or the right 
rear is typically lost. 

[06] A common downmixer for classical music, for example utilizing a European 
Standard for 5 channel downmixing, mixes the two rear channels directly into the output 
channels, without any inversion of phase. This may preserve the left/right directionality of 
15 the rear channels, but does not preserver an indication that the signals were intended to be 
heard behind the listener. The resulting mix causes the downmixed signal to appear as if it 
were in fi-ont of the listener, both in two channel playback, and when played through a 
standard film decoder. 

[07] Some downmixers may slightly vary mix ratios as an attempt to preserve 
20 signal energy, for example, where surround input signals are anticorrelated with respect to 
one another. However, signal energy and apparent direction of the muhichannel signal is not 
substantially preserved, for example, where the input signal pans between input channels. 

[08] Further, both the standard film downmixer, and the European Standard 
downmixer attenuate the rear channels by 3dB before mixing them into the output channels. 
25 This attenuation may cause the loudness of a sound effect applied to one of the rear channels 
to be lower than the original five channel mix. In this case the energy in the rear inputs is not 
preserved in the output channels. 

[09] Yet another problem with the above discussed encoders/decoders is in the 
handling of sound events (i.e., a short burst of sound with a well defined beginning and that 
30 may or may not have a well defined end, such as notes fi-om an instrument, or syllables in 

speech) when downmixing the input signal. The downmixing algorithms employed cause the 
sound event to be reduced in emphasis in the downmixed signal, especially in the presence of 
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reverberation. The downmixers discussed above cause the sound events to be downmixed in 
the front channels. However, when these sound events are downmixed into the front 
channels, they may become less audible or even inaudible. 

[10] Further, downmixers that mix three front channels into two output channels 
5 suffer from a directional localization problem, where sounds that are mixed in a three channel 
recording so they are perceived as coming half-way between the left (or right) front channel 
and the center channel, are perceived as coming from a different spot when the three channel 
signal is downmixed to two channels and reproduced through two loudspeakers. In practice, 
the sound image in the two channel downmix is almost at the left loudspeaker (or right), 
10 instead of exactly half-way between the center and the left. 

[11] Therefore, a need exists for a downmixer that preserves the intended direction 
and the signal energy of a multichannel mix. Additionally, a need exists for a downmixer 
that properly mixes an input signal in the presence of reverberation and that emphasizes 
sound events within the input signal during the downmixing process. 

15 SUMMARY 

[12] A downmixer system is provided for generating mix coefficients for 
downmixing a multichannel input signal having a plurality of input channels, to an output 
signal having a plurality of output channels. Mix coefficients may be generated responsive to 
a comparison of energy between the downmixed (output) signal and the input signal to the 

20 downmixer, such that energy and intended direction of the input signal is substantially 
preserved in the output signal. The number of input channels of the input signal may be 
greater than, or equal to, the number of output channels in the output signal. Further, or in 
the alternative, the mix coefficient generation may preserve intended direction of an input 
signal, for example, received at a surround input channel, in at least one output channel of the 

25 output signal. In this circumstance, the preserved intended direction may be utilized at an 
upmixer capable of decoding surround channel information, to place the surround channel 
information in the surround channel(s) of the upmix. 

[13] The mix coefficients may be generated in a test downmixer environment, 
where the test downmixer environment may be utilized to generate the mix coefficients 

30 responsive to input and output signal energy determined using limited-bandwidth (i.e.. 
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filtered) input signals received at the test downmixer. The mix coefficients determined using 
the test downmixer may then be utilized in a fiill-bandwidth downmixer. 

[14] Mix coefficient values may be generated by retrieving predetermined mix 
coefficient values. The predetermined mix coefficient values may be stored in a tabular 
5 format at a storage device of the downmixer, for example, as one-dimensional or two- 
dimensional tables. The tables may be indexed by a ratio of output energy to input energy. 
When a substantially similar output to input ratio is encountered while downmixing an input 
signal, it may be possible to retrieve one or more mix coefficients from a mix coefiHcient 
table to be used in downmixing the input signal. 

10 [15] Mix coefficients may be generated responsive to an input energy of a plurality 

of the input channels. An energy ratio between at least one of the input channels and at least 
another of the input channels may be determined, where the mix coefficient generation is 
responsive to the energy ratio. The mix coefficient generation may include increasing one or 
more mix coefficient values, or decreasing one or more mix coefficient values. Further, a 

15 beginning of a sound event may be detected, where the mix coefficient generation may be 
responsive to the input energy and the beginning of the sound event detection. 

[16] Other systems, methods, features and advantages of the invention will be, or 
will become, apparent to one with skill in the art upon examination of the following figures 
and detailed description. It is intended that all such additional systems, methods, features and 

20 advantages be included within this description, be within the scope of the invention, and be 
protected by the following claims. 

Brief Description Of The Drawings 

[17] The invention can be better understood with reference to the following 
drawings and description. The components in the figures are not necessarily to scale, 
25 emphasis instead being placed upon illustrating the principles of the invention. Moreover, in 
tiie figures, like referenced numerals designate corresponding parts throughout the different 
views. 

[18] Figure 1 is a functional block diagram of a downmixer device for downmixing 
a three channel input signal to a two channel output signal. 

4 
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(19J Figure 2 is a flowchart illustrating operation of the downmixer device of 
Figure 1. 

[20] Figure 3 is a flowchart illustrating generation of the mix coefficients of the 
downmixer of Figure 1 and the downmixer of Figure 9. 
5 [21] Figure 4 is a flowchart illustrating the determining channel energy of Figure 3 

that may be used in downmixing a three channel input signal to a two channel ou^ut signal. 

[22] Figure 5 is a flowchart illustrating the determining of a feedback constant of 
Figure 3 that may be used in downmixing a three channel input signal to a two channel output 
signal. 

10 [23] Figure 6 is a flowchart illustrating the generating of channel mix coefficients 

of Figure 3 that may be used in downmixing a three channel input signal to a two channel 
output signal. 

[24] Figure 7 is a graph of mix coefficients generated in accordance with the flow 
charts of Figures 4-6 for a single input signal panned from the center to left channel. 
15 [25] Figure 8 is a graph of mix coefficients as a function of panning angle, derived 

experimentally to compensate for the subtle error in localization when a three channel signal 
is downmixed and reproduced through two channels. 

[26] Figure 9 is a functional block diagram of a downmixer device for downmixing 
a 5.1 channel input signal to a two channel output signal. 
20 [27] Figure 10 is a flowchart illustrating operation of the downmixer device of 

Figure 9. 

[28] Figure 1 1 is a flowchart illustrating determining VP and O/P channel energy 
for generation of Figure 3 for the downmixer of Figure 9. 

[29] Figure 12 is a flowchart illustrating the generating of at least one feedback 
25 constant of Figure 3 for the downmixer of Figure 9. 

[30] Figure 13 is a flowchart illustrating the generating one or more mix 
coefficients of Figure 3 for the downmixer of Figure 9. 

[31] Figure 14 is a flowchart illustrating the adjusting of mix coefficients generated 
for the downmixer of Figure 9. 
30 [32] Figure 15 is a flowchart illustratuig the determining channel energy of Figure 

14. 

5 
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[33] Figures 16-17 are flowcharts illustrating the adjusting of one or more mix 
coefficients of Figure 14. 

Detaileo Description of the Preferred Embodiments 

[34] A downmixer system is provided for generating mix coefficients for 
downmixing a multi-channel input signal having a plurality of input channels to an output 
signal having a plurality of output channels. An input energy level may be determined for at 
least a plurality of the input channels, and mix coefficients may be generated responsive to 
the determining at least one of the input and output energy levels such that the signal energy 
and the intended direction of the input signal are substantially preserved. An output energy 
level may be determined for at least one of the output channels, where mix coefficients may 
be generated responsive to the input and output signal energy such that the signal energy and 
the intended direction of the input signal are substantially preserved in the output signal. 

[35] The number of output channels in the output signal may be less than the 
number of input channels of the input signal, for example, when a three channel input signal 
is downmixed to a two output channel output signal. The number of input channels of the 
mput signal may be equal to the number of output channels of the output signal, for example, 
where the downmixer is utilized to downmix surround channel information. 

[36] The downmixer may provide a listener of the output signal with a substantially 
accurate rendition of the apparent direction and relative loudness of the input signal. When 
downmixing an input signal including both front channel and surround channel information, 
the downmixer may be capable of downmixing the front channel and surround channel 
information independently, to substantially preserve energy and intended direction of the 
input signal at the output signal. The downmixed surround and downmixed front channel 
information may be combined (i.e., added together) to produce a two channel mix of the input 
signal. 

[37] The downmixer may be capable of altering an energy ratio between front input 
channels and surround input channels of the input signal during downmbdng of the input 
multichannel signal to the output signal. The energy ratio alterations may be utilized to 
provide a substantially accurate rendition of reverberation present in the multichannel input 
signal to the output signal. The energy ratio alterations for downmixing may be 

6 
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accomplished through mix coefficient adjustments. Additionally, mix coefficients may be 
adjusted to emphasize sound events (i.e., notes from an instrument, syllables (phones) of 
speech, etc.). Sound events may occur in one or more of the input channels, for example, the 
left and right surround channels, to provide a substantially accurate rendition of the sound 
events at the output signal of the downmixer. 

[38] Dovmmixers for downmixmg input signals with 3 input and 5. 1 input channels 
to an output signal having 2 output channels will be discussed below. However, it will be 
apparent that the teachings herein may be applied to input signals having a different number 
of input channels, and that may be downmixed to an output signal with more than two output 
channels. 

[39] Figure 1 is a functional block diagram of a downmixing device capable of 
downmixing a multi-channel input signal mcluding at least 3 input channels to an output 
signal including a number of output channels less than the number of input channels, here 2 
output channels. As shown in Figure 1, a downmixer 100 includes a full-bandwidth 
downmixer generally indicated at 102, for downmixing the multi-channel input signal to the 
output signal responsive to generated left and right channel mix coefficients ml and mr, such 
that signal energy and an intended direction of the input signal are substantially preserved in 
the output signal. The fiill-bandwidth downmixer 102 is capable of downmixing over a broad 
range of frequencies, for example, over the 20 - 20,000 frequency range. Other frequency 
ranges are possible. The downmixer 100 may further include a test downmixer 104, and a 
controller 106, where the test dovmmixer 104 and controller 106 may be utilized for 
generating test mix coefficient values, that may be used to update the left and right mix 
coefficients ml and mr of the full-bandwidth downmixer 102, to allow substantial 
preservation of the signal energy and intended direction of an input signal at the output 
signal, as described below. The test downmixer may operate over a limited frequency range, 
for example 700 - 4000 Hz frequency range. Other frequency ranges are possible. The 
limited frequency range of operation of the test downmixer may be advantageous as allowing 
the mix coefficients of the full-bandwidth downmixer 102 to be generated using a range of 
frequencies over which human listeners may be particularly sensitive. Generating the mix 
coefficients in this fashion may allow for mix coefficient generation that more accurately 
reflects loudness of the input signal at the output signal, as perceived by human listeners. 
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[401 As energy and intended direction are substantially preserved at the test 
downmixer 104 using the test mix coefficients, the test mix coefficient values, if used in the 
full-bandwidtii downmixer, will allow the energy and intended direction of the input signal at 
the full-bandwidth downmixer to be substantially preserved in the output signal. Upon 
5 generation of the mix coefficients by the test downmixer 104 and controller 106, the 
generated values may be utilized to update the mix coefficients of the full-bandwidth 
downmixer 102. 

[41] As shown in Figure 1, the full-bandwidth downmixer 102 is capable of 
downmixing an input signal having 3 channels, for example, left (LI), center (CI) and right 

10 (RI) input channels to be downmixed to an output signal having 2 channels, for example, left 
output (LO) and right output (RO) channels. 

[42] The full-bandwidth downmixer 102 includes a first mixer 108 and a second 
mixer 1 10, the first and second mixers specifying mix coefficients including a left channel 
mix coefficient ml and a right channel mix coefficient mr respectively, for mixing the CI 

15 channel with the LI and RI channels. The CI channel may be mixed with the LI and RI 
channels to generate respective L' and R' channels. The first mixer 108 is coupled with a 
first phase shifter 1 12 for providing a desired phase shift to the L' channel, for generating the 
LO channel of the output signal. Similarly, the second mixer 1 10 is coupled with a second 
phase shifter 1 14 for applying a desired phase shift to the R' channel, for generating the RO 

20 channel of the output signal. The phase shifters 1 12 and 1 14 may be capable of providing a 
pure phase shift to the L' and R' channel information such that the energy and amplitude of 
the L' and R* are not affected at any frequency. 

[43] The test downmixer 104 may include a first test mixer 116 and a second test 
mixer 118. The first test mixer 1 16 may be capable of receiving at least one of a limited- 

25 bandwidth (i.e., filtered) LI and CI channel information as LIum and CiLim, respectively, and 
mixing the Llum and Clum channel information using a test left channel mix coefficient ml' to 
form a limited-bandwidth test mixer left output channel LOluh. Similarly, the second test 
mixer 118 may be capable of receiving at least one of a limited-bandwidth RI channel 
information RiLim and the Clum channel information, and mixing the Rlum and Clum channel 

30 information using a test right channel mix coefficient mr* to form a limited-bandwidth RO 
output channel ROum of the test mixer 104. 

8 
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[44] The controller 106 is coupled with the first mixer 108, the second mixer 1 10, 
the first test mixer 1 1 6 and the second test mixer 118. The controller 1 06 is capable of 
receiving one or more of the LI, CI and RI channel information of the input signal, and 
determining limited-bandwidth (i.e., filtered) channel information, for example, Llum, CiLim, 
and Rlum for use in the test downmixer 104. The controller 106 is additionally capable of 
receiving output channel information, for example the output channel information LO and 
RO fi-om the full-bandwidth downmixer 102, and/or the limited-bandwidth output channel 
information LOtim and ROLim from the test downmixer 104, and generating values for one or 
more mix coefficients, for example, the mix coefficients ml and mr of the full-bandwidth 
dovmmixer 102, as described below using the test downmixer 104. The controller 106 may 
further be coupled with a storage device 120, providing one or more memory devices that 
may be utilized by the controller 106, for example, as a working memory and/or program 
memory during operation of the downmixer. 

[451 Figure 2 is a flow chart illustrating operation of the downmixer 100 in 
downmixmg a multi-channel (i.e., > 2 channel) input signal, here having three channels, to an 
output signal having a number of channels less than input signal, here two channels. As 
shown in Figure 2, input channel information is received 200 at the full-bandwidth 
downmixer 102, for example as LI, CI, and RI channel information. 

[46] The controller 106 is capable of generating 202 at least one of the mix 
coefficients ml and mr used by the first and second mixers 108 and 1 10 to mix the LI, CI and 
RI channel information, for example, using the test downmixer 104, as will be discussed 
below. The full-bandwidth downmixer 102 may mix 204 the LI and CI channels at the first 
mixer 108 to form the L' channel, as 

L' = LI-f ml*C. (eqn. I) 

[47] The first phase shifter 1 12 may then provide 206 a desired phase shift to the L' 
channel information, where the resulting channel information is provided 212 as the LO 
channel of the output signal. 

[48] Similarly, the second mixer 1 1 0 may mix 208 the RI and CI channels to form 
the R' channel, as 

R'=RI + mr*C. (eqn. 2) 



9 
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[49] The second phase shifter 1 14 may then provide 210 any desired phase shift to 
the R* channel information, where the resulting channel information is provided 212 as the 
RO channel of the output signal. 

[50] Although the generating 202 is shown as occurring at a particular location in 
5 the flow chart of Figure 2, it will be apparent that the generating of mix coefficients may be 
accomplished at any time during the operation of the full-bandwidth downmixer 102 and/or 
may be accomplished at multiple intervals during operation of the fiill-bandwidth downmixer 
102. 

[51] The mix coefficients ml and mr may be generated 202 at the same time or at 
10 separate times during operation of the full-bandwidth downmixer 102. Additionally, in some 
circumstances, it may be desirable to generate only a single mix coefficient, for example, ml 
or mr, to be utilized by the fiill-bandwidth downmixer 102. Further, or in the alternative, the 
generating 202 may be accomplished periodically during mixing of the input signal, for 
example, at some time interval (i.e., every 1.5 ms or 10 ms), or after processing a particular 
15 amount of input channel information (i.e., 64 samples or 640 samples of input channel 
mformation). Upon generating one or both of the mix coefficients ml and mr, the 
controller 106 may update the respective first and/or second mixer 108 and 110 with an 
updated value for one or both of the updated mix coefficients. Such updating of mix 
coefficient values may occur any time during downmixing of an input signal to the output 
20 signal. 

[52] Mix coefficient generation will be described generally with respect to the flow 
chart of Figure 3. The flow charts and graphs of Figures 3-8 and 1 1-13 will be discussed in 
the context of Figure 3, to describe mix coefficient generation for various circumstances. 

[53] Figure 3 is a flowchart illustrating the generating 202 of the mix coefficients, 

25 for example, the left and right channel mix coefficients ml and mr. The mix coefficient 
generation may occur, for example, at the test mixer 104 and controller 106. As shown in 
Figure 3, at least one of an input and an output channel energy may be determined 300, for 
example, by the controller 106, using the test downmixer 104. The controller 106 may then 
determine 302 one or more feedback constants, for example, to smooth/stabilize mix 

30 coefficient value generation, especially in the presence of rapidly varying input channel 

information. The controller may then generate 304 mix coefficient(s), for example, the test 
mix coefficients ml' and mr ' responsive to the channel energy and/or feedback constant(s). 

10 
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The mix coefficients of the full-bandwidth downmixer 102 may be updated with the values of 
the test mix coefficients. 

[541 As is described below, the controller 106 typically generates the mix 
coefficient values utilizing limited-bandwidth input signal information, for example, by 
filtering the LI, CI and/or RI channel information to accentuate audible frequencies, for 
example, in the 700-4000 Hz frequency range. The filtering may accentuate other frequency 
ranges. Filtering the input channel information may allow the generated mix coefficients to 
reflect more accurately the loudness of the sound as perceived by human listeners. Although 
the full-bandwidth downmixer 102 is typically a broad band downmixer capable of 
downmixing input signals over a broad range of frequencies, for example 20 Hz - 20 KHz, 
human hearing may be particularly sensitive to the energy content in the middle frequencies, 
for example the 700-4000 Hz frequency range, and determining the mix coefficients 
responsive to the middle frequency range is advantageous as allowing loudness of the input 
signal to be preserved in frequencies to which human listeners are most sensitive. 
Alternatively, or in addition, the controller 100 may generate mix coefficient values using 
full-bandwidth input channel information (i.e., non-filtered input channel information). 

[55] The generating of one or more mix coefficients will be discussed below for 
various situations. For example, Figures 4-6 are flowcharts illustrating operation of the 
controller 106 utilizing the test downmbcer 104 for generating mix coefficients that may be 
used in downmixing a three channel input signal to a two channel output signal. Figure 7 is a 
graph illustrating mix coefficients generated by the downmixer 100 in accordance with the 
flowcharts of Figures 4-6, with a particular input signal, such that energy and intended 
direction of the input signal is substantially preserved at the output signal. Figure 8 is a graph 
illustrating ideal mix coefficients determined experimentally for the particular input signal, 
such that energy and intended direction of the mput signal is substantially preserved at the 
output signal. An input signal scenario used in generating the graphs of Figures 7 and 8, may 
be utilized in generating predetermined mix coefficient values as described below. Other 
input signal scenarios may be used. Figures 11-13 illustrate mix coefficient generation for a 
downmixer capable of downmixing 5.1 input channels to two output channels. 

[56] Figures 4-6 are flow charts illustrating the mix coefficient generation of 
Figure 3 that may be utilized in downmfacing a three channel input signal to a two channel 
output signal. 

11 
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[57] Figure 4 is a flow chart illustrating operation of the controller 1 06 and the test 
downmixer 104 in determining 300 at least one of an input and output channel energy. As 
shown m Figure 4, input channel information is received 400 at the controller 106, including 
LI, CI and RI channel information. The input channel information 400 that is received may 
5 include one or more digital signal samples of audio information received as the input signal 
representing at least one of the LI, CI and RI channel information. 

[58] The input channel information may be filtered 402 by the controller 106 to 
form limited-bandwidth input channel information Lltim, Clum and Rlum. For example, the 
input channel information may be filtered to emphasize substantially audible fi-equencies of 
10 the input signals, such as in the 700 to 4,000 Hz frequency range. Limited-bandwidth input 
channel energy may then be determined 404 by the controller 106 for LI and RI channels, 
respectively, as 

ELIum = LlLim^ + Clurn^, and (eqn. 3) 

ERlLim = RlLim^ + CIun. . (eqn. 4) 

15 [59] A limited bandwidth LO and RO channel information LOum and ROtm may 

be determined 406 at the test downmixer 104, as 

LOum = LIum + ml', * Clum, and (eqn. 5) 

ROum Rlura + mr' * CLum. (eqn, 6) 

[60] Limited-bandwidth output channel energy may determined 408 by the 
20 controller 1 06 for the LO and RO channels, respectively, as 

ELOtim = LOLim^, and (eqn. 7) 

EROura = ROum^. (eqn. 8) 

The limited-bandwidth input and output channel energy determined at 404 and 408 are 
typically averaged by the controller 106 over a plurality of samples of the input channel 
25 information received at the controller 106. The plurality of samples comprise a first time 
period, that may include, for example, 64 samples of the received 400 input channel 
information. 

[61] The limited-bandwidth input and output channel energy is determined as total 
limited-bandwidth energy for the LIum, LOLim, Rlum. and ROum channels that may be 
30 averaged 410 as ELIsum, ELOsum, ERIsum, EROsum channel energy, respectively, where 

ELIsum = ELIsum + ELIum (eqn. 9) 

ERIsum = ERIsum + ERItin, (eqn. 1 0) 
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ELOsum = ELOsum + ELOum, and (eqn. 1 1 ) 

EROsum = EROsuni+ EROum . (eqn. 12) 

[62] Next, it may be determined 412 whether the averaging is complete. Where it 
is determined 412 that the averaging is not complete, flow returns to the receiving 400 input 
5 channel information as discussed above. However, where it is determined 412 that the first 
time period is complete, total limited-bandwidth input and output channel energy is 
determined 414 as total limited-bandwidth left and ri^t channel input and output energy 
EINLum, EINRum, EOUTLLim, and EOUTRLim respectively, where 

EINLum = ELIsum + ECIsum (eqn. 13) 

10 EINRum = ERIsum + ECIsum (eqn. 14) 

EOUTLLim = ELOsum, and (eqn. 1 5) 

EOUTRLim = EROsum- (eqn. 16) 

[63] Upon determining at least one of an input and an output channel energy at 
300, a feedback constant(s) may be determined 302 in accordance with the flowchart of 
15 Figure 5. 

[64] Figure 5 is a flowchart illustrating operation of the controller 106 in 
determining at least one feedback constant for generating mix coefficients to downmix a 
three channel input signal to two output channels. At 500 it is determined whether a total LO 
channel energy, EOUTLum , is greater than a total limited-bandwidth LI channel energy, 

20 EINLLim . Where it is determined 500 that the total limited-bandwidth LO energy is not 

greater than the total limited-bandwidth LI energy, a left-channel feedback constant fbl may 
be generated 502 by the controller 106 as 

fbl = 0.98* fbl. (eqn. 17) 

The left-channel feedback constant fbl may be initialized to a value of, for example, I . Other 

25 initial values for the feedback constant may be utilized, for example, between 0 and 1 . 

However, where it is determined 500 that the total limited-bandwidth LO channel energy is 
greater than the total limited-bandwidth LI channel energy, a left-channel feedback constant 
is generated 504 by the controller 106 as 

fbl = 0.98 fl^l + gfb ((EOUTLum / EINLLim )-l), (eqn. 1 8) 

30 where gfb may have a value of 0.04. The value for gfl> may be selected experimentally with 
considerations, for example, that a high value of gfb may cause feedback loop instability, 
and a low value of gfb may substantially reduce or eliminate feedback action. 
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[65] Upon generating 502 or generating 504 the feedback constant, it is determined 
506 whether the total limited-bandwidth RO channel energy, EOUTRum, is greater than the 
total limited-bandwidth RI channel energy, EINRum. Where it is determined 506 that the 
total limited-bandwidth RO channel energy is not greater than the total limited-bandwidth RI 
channel energy, a right-channel feedback constant fbr may be generated 510 by the controller 
106 as 

fbr = 0.98*fbr. (eqn. 19) 

A value for fbr may be initially set as one. However, where it is determined that the total 
Ihnited-bandwidth RO channel energy is greater than the total limited-bandwidth RI channel 
energy, the right-channel feedback constant fbr may be generated 508 by the controller 106 
as 

fbr = 0.98 fbr + gfb ((EOUTRum /EINRum (eqn. 20) 

[66] Although not shown, it will be apparent that the total limited bandwidth LO 
channel energy, the total limited bandwidth RO channel energy, the total limited-bandwidth 
LI energy and/or the total limited-bandwidth RI energy may be filtered, for example, low- 
pass filtered, before determining one or both of the feedback constants fbl and fbr. The 
filtering may be accomplished at the controller 106, for example, as low-pass filtering. The 
low pass filtering may utilize, for example, a 70 ms time constant. Other time constants may 
be utilized. Further, it will be apparent that at least some of the filtering may not be carried 
out by the controller 106, but rather the filtering may be accomplished by one or more filters 
embodied as hardware devices. 

[67] Returning to Figure 3, upon determining 302 the feedback constant(s), one or 
more test mix coefficients may be generated 304 by the controller 106 as described with 
respect to the flowchart of Figure 6. As shown in Figure 6, a test left channel mbc coefficient 
ml' may be generated 600 by the controller 106 as 

ml' = 0.71 + fbl * If + fbr * rf, (eqn. 21) 

where fbl and fbr have values as determined above with respect to Figure 5, If has a value of 
-I and rf has a value of 0.3. The values for If and rf may be used to bias the test mix 
coefficients ml' and mr' respectively. The test mix coefficients may be biased using If and 
rf, for example, to compensate for a subtle error in localization (i.e., intended direction) 
when a three channel signal is downmixed and reproduced through two channels. Other 
values for If and rf may be utilized. 
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[68] After generating 600 a value for the test left channel mix coefficient ml', the 
value for the test mix coefficient ml' may be limited 602 to a value between 0 and 1 . For 
example, where ml' is determmed to be less than 0, ml' is set to a value of 0, and where ml' is 
determined to be greater than 1, ml' is set to a value of 1 . 
5 [69] A test right channel mix coeflBcient mr* may then be generated 604 by the 

controller 105 as 

mr* = .71 + fbl * rf + fbr * If, (eqn. 22) 

where fbl, fbr, rf and If have values as discussed above with respect to the generating 600. 
[70] After generating the test mix coefficient mr', a value for mr' may be limited 
10 606 to a value between 0 and 1. For example, where the test mix coefficient mr' is 
determined to be less than 0, mr* may be set to a value of 0, and where the test mix 
coefficient mr' is determined to be greater than 1, nu*' may be set to a value of 1 . 

[71] The test mixer down mixer left and right mix coefficients ml' and mr' have 
been determined, for example, using the feedback constant fb, to substantially preserve the 
15 energy and intended direction of the lunited-bandwidth input signal received at the test down 
mixer 104 in the output signal of the test mixer. As energy and intended direction are 
substantially preserved at the test downmixer 104 using the test mix coefficients, the test mix 
coefficient values, if used in the fuli-bandwidth downmixer 102, will allow the energy and 
intended direction of the input signal at the fiill-bandwidth downmixer to be substantially 
20 preserved in the output signal. The test mix coefficients values mP and mr' may be used to 
update 608 the mix coefficient values ml and mr used in the flill-bandwidth downmixer 102. 

[72] The updating 608 may be accomplished by the controller 106 updating the left 
channel mix coefficient ml of the first mixer 102 with the value of the test left channel mix 
coefficient ml', by replacing the value of ml with the value of ml'. Similarly, the right 
25 channel mix coefficient mr may be updated by the controller 106 updating the right channel 
mix coefficient mr of the second mixer 104 with Ae value of the test right channel mix 
coefficient mr', by replacing the value of mr with the value of mr'. 

[73] In addition, or in the alternative, the left and right channel mix coefficients 
may be updated 608 by the controller 106 by smoothing the mix coefficients before they are 
30 used in the full-bandwidth downmixer that actually produces to output signals. This 
smoothing may occur in the time between calculation of new values for ml and mr. For 
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example, about every one-half of a millisecond the value of ml in the full bandwidth 
downmixer may be altered (i.e., updated) in such a way as to bring it closer to the calculated 
value ml\ The change is made so that the value of ml' is reached by ml in the full bandwidth 
downmixer before another value of ml' is determined at the test downmixer 1 04. The same 
5 may be true wltii respect to updating the mix coefficient value mr with the test mix 
coefficient value mr' . 

174] In this way, the left and right channel mix coefficients ml and mr may be 
generated 304 for the full-bandwidth downmixer 102. 

[75] Figure 7 is a graph of mix coefficients that may be generated by the 
10 downmixer 100 in accordance with the flow charts of Figures 4-6 for a single input signal 
presented to the CI and LI channels. The graph of Figure 7 is generated by the single signal 
panned smoothly between the LI and CI channels, where the intended direction of the input 
signal is precisely known. Figure 8 is a graph of mix coefficients as a function of panning 
angle derived experimentally to compensate for a subtle error in localization when a three 
15 channel signal is downmixed and reproduced through two channels. The graph of Figure 8 
illustrates a calculated ideal case, where there is a single signal panned smoothly between the 
LI and CI channels, and where the intended direction of the input signal is precisely known. 
Left channel mix coefficient ml values are designated in Figures 9 and 10 using a dashed line, 
and right channel mix coefficient mr values are designated in Figures 9 and 1 0 using a solid 
20 line. 

[76] It will be apparent that mix coefficients, for example, ml and mr, may be 
generated 202 (Figure 2), as predetermined values responsive to input channel energy, and 
need not be generated in real-time. Such a scheme may utilize frequency limited input and 
output energy from a test downmixer as inputs to one or more one-dimensional or two- 
25 dimensional look-up tables. As is apparent from the preceeding explanation for the operation 
of a downmixer, the mix coefficient may depend on the ratio of input energy to the output 
energy. Look-up tables where the input to the table is the output/input energy ratio as 
determined by a test downmixer may be used to derive mix coefficients such as ml and mr 
directly. 

30 [77] To generate the predetermined mix coefficients stored in such look-up tables, 

for example, the mix coefficients ml and mr, the controller 106 and a downmixer, for 
example, the downmixer 102 or the test downmixer 104 may be utilized, where an input 
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signal for a particular input signal scenario (i.e., having characteristics of a smooth pan from 
CI to LI, for example as was used to generate the graph of Figure 8) may be processed by the 
downmixer to determine a ratio between an output energy and an input energy resulting from 
the input signal scenario. The downmixer and controller 106 may then be utilized to 
determine at least one mix coefficient, for example, the mix coefficients ml and mr that may 
be utilized with the particular input signal scenario such that signal energy in an intended 
direction of the input signal is substantially preserved at the output (downmixed) signal. The 
mix coefficients may be generated, for example, as discussed above with respect to Figures 4- 
6. 

[78] The ratio between the output and input energies for that particular input signal 
scenario may be stored in a tabular format at the storage device 120. Such a tabular format 
may include, for example, the mix coefficients ml and mr indexed by the ratio of output to 
input energy for one or more input signal scenarios. For example, a mix coefficient table 
for ml may be provided, and indexed by a ratio of output to input signal energy for particular 
input signal scenarios. Similarly, a mfac coefficient table for mr may be provided and indexed 
by the ratio between output and input signal energy for the particular scenario. 

[79] In operation, the controller 106 may detect a particular input signal scenario, 
determine a ratio between output and input energies, and based on the ratio, lookup values for 
at least one mix coefficient, for example, the mix coefficients ml and mr to be used by the 
downmixer to downmix tiie signal for that input signal scenario. The mix coefficient(s) 
retrieved allow that input energy and intended direction of the input signal to be substantially 
preserved at the output signal. The controller may update mix coefficient values in the 
downmixer with the retrieved mix coefficient values, for example, in a similar fashion as 
discussed above with respect to the updating 608 of Figure 6. 

[80] In this way, a library of predetermined mix coefficient scenarios may be 
determined, and for example, stored at the storage device 120. The library may include mix 
coefficient tables for mix coefficients, where, for example, each mix coefficient table 
provides one or more mix coefficients indexed by a ratio of output to input energy. Other 
mix coefficient table configures may be possible. The mix coefficient library may be 
accessed by the controller in retrieving mix coefficient values for a particular input signal 
scenario. 
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[81] The predetermined mix coefficient generation may be utilized in conjunction 
with the mix coefficient generation generation described above with respect to Figures 6-8. 
For example, the controller may attempt to identify whether the input signai meets 
requirements for a particular input signal scenario for which the mix coefficient library 
5 includes a predetermined mix coeflHcient(s). Where the controller 106 determines that the 
input signal fits one of the input signal scenarios for which mix coefficients are stored, the 
controller may generate mix coefficients by retrieving appropriate mix coefficients from the 
mix coefficient library as described above. However, where the controller 106 determines 
that the input signal does not meet criteria for a stored input signal scenario, the controller 
10 may, in conjunction with the test mixer 104, generate mix coefficients for the downmixer. 

[82] Additionally, or in the alternative, the controller may employ a learning 
algorithm, allowing it to identify characteristics for input signal scenarios, for which 
predetermined mix coefficients would be useful (i.e., input signal scenarios that are 
repeatedly received in an input signal at the downmixer). In such circumstances, the 
15 controller may be capable of using the test downmixer to determine mix coefficient values for 
the particular input signal scenario, and stored in the storage device 120. Upon subsequent 
recognition of the input signal scenario, the controller 106 may generate mix coefficients for 
the scenario by retrieving the mix coefficients jfrom the mix coefficient table. 

[83] By generating mix coefficient values by retrieving mix coefficients as 
20 described above, the controller may generate mix coefficient values that may allow input 
signal energy and intended direction to be preserved in the output signal with less of a 
demand on downmixer resources than may be required to generate the mix coefficients as 
described above with respect to Figures 4-6. Downmixer resources may be freed-up for use 
by the downmixer in other operations. 
25 [84] Figure 9 is a block diagram of a downmixer 900 in accordance with the 

invention. The downmixer 900 is capable of receiving a multi-channel input signal including 
more than two channels and down-mixing the multi-channel input signal to an output signal 
including a number of channels Jess than the number of channels of the input signal. The 
downmixer 900 includes a full-bandwidth downmixer 901 for downmixing the 5.1 channel 
30 input signal to the two-channel output signal utilizing at least one of the front channel left and 
right mix coefficients ml and mr, and the surround channel mix coefficients mi and ms, such 
that the energy and intended direction of the input signal is substantially preserved in the 
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output signal. The downmixer 900 further Includes a test downmixer 104' which may be 
utilized in conjunction with a controller 940 in generating front channel left and right mix 
coefficients ml and mr. As the front channel mix coefficients ml and mr may be generated in 
a similar fashion as the mix coefficients ml and mr by the test mixer 104 and controller 106 
of Figure 1, operation of the test mixer 104' will not be discussed in detail. The downmixer 
900 may further include a test downmixer 950 which may be utilized with the controller 940 
in generating one or more of the surround mix coefficients, for example, the surround mix 
coefficients mi and ms, such that signal energy and intended direction of the input signal is 
substantially preserved in the output signal of the full-bandwidth downmixer 901. 

[85] As shown in Figure 9, a front left input (LI), front center input (CI), front right 
input (RI), low frequency (LFE), left surround input (LSI) and right surround input (RSI) 
channels may be received at the downmixer 900. The downmixer 900 is capable of down 
mixing the 5. 1 input channels of the input signal to an output signal including, for example, 
two output channels, a left output (LO) and right output (RO) channel. 

[86] The full-bandwidth downmixer 901 may include a first LI mixer 902 for 
mixing the LI, CI and LFE channels and a first RI mixer 904 for mixing the RI, CI, and LFE 
input channels of the input signal. Multipliers 906 and 908 may be utilized to multiply the CI 
input signal by respective front left and right channel mix coefficients ml and mr before 
mixing the CI channel at the first LI mixer 902 and first RI mixer 904. A second LI mker 
910 may allow components of one or both surround channels LSI and RSI to be added to the 
LP channel information, and a LI phase shifter 912 may be provided to accomplish any 
desired phase shift to form LO' channel information. Similarly, a second RI mixer 914 may 
be provided for adding components of one or both surround channels LSI and RSI to the RI' 
channel information, and a RI phase shifter 916 may be provided to accomplish any desired 
phase shift to form RO' channel information. 

[87] An LSI mixer 918 may be provided to add a component of the RSI channel to 
the LSI channel, and a multiplier 922 may be provided for accounting for a LSI mix 
coefficient, for example a mi surround mix coefficient corresponding to an imaginary 
component LSP of the LO chMinel. A LSI phase shifter 924 may be provided to accomplish 
any desired phase shift to the LSI' channel information to form the LSO' channel 
information. Similarly, a RSI mixer 930 may be provided for adding a component of the LSI 
channel to the RSI channel, a multiplier 932 allows for the mi surround mix coefficient to be 
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accounted for, and a RSI phase shifter 934 may be utilized to provide any desired phase shift 
to the RSr channel information to form RSO' channel information. 

[88] Multipliers 919 and 921 may be provided to account for a ms surround mix 
coefficient. For example, the ms surround mix coefficient may be utilized to control an 
amount of the LSI and RSI channels that are added to the respective front channel output 
path, for example, to the LP and LO' signals, respectively. 

[89] A LO mixer 936 may be provided to mix the LSO* and LO* channel 
information to form an output channel LO of the output signal. Similarly, a RO mixer 938 
may be utilized to mix the RO* and RSO' channel information to form the RO output channel 
of the output signal. 

[90] The test dowranixer 950 may include a first test adder 952 and a second test 
adder 954. The first test adder 952 is coupled with a first test mixer 956 and a second test 
mixer 958, to account for test surround mix coefficients mi* and ms' at the test mixer 950. 
Similarly, the second test adder 954 is further coupled with a third test mixer 960 and a fourth 
test mixer 962 capable of accounting for the test surround mix coefficients ms' and mi* 
respectively in the test downmixer 950. 

[91] The controller 940 may be coupled with one or more of the input channels, for 
example, the LSI, LI, CI, LFE, RI and RSI input channels, as well as with one or more of the 
multipliers 906, 908, 919, 921, 922 and 932 of the full-bandwidth downmixer 901, for 
generating and/or updating one or more of the mix coefficients ml, mr, ms, and mi, utilizing 
the test downmixers 140' and 950. To reduce confusion, the coupling between the controller 
940 and the multipliers 906, 908, 919, 921, 922 and 932 are shown with dotted lines. 

[92] The first test adder 952 is capable of receiving a limited-bandwidth (i.e., 
filtered) LSI channel information as LSIum, received at the test downmixer 950 and 
attenuated by a factor of 0.91. The first test adder 952 is further capable of receiving a RSI 
limited-bandwidth channel information as RSIum that has been inverted, and multiplied by a 
cross-correlation factor-0.38, and adding that with the attenuated LSlLim signal. The resulting 
channel information fi-om the first test adder 952 may then be mixed at the first and second 
test mixers 956 and 958 in accordance with test siuround mix coefficients mi' and ms', to 
generate test mixer 950 output channel information LSO-Imum and LSO-ReLim respectively. 
Similarly, the second test adder 954 may be capable of adding an inverted RSIum channel 
mformation, attenuated by a factor of 0.91, with LSIum channel information that has been 
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multiplied by a cross-correlation factor -0.38. The resulting channel information may then be 
mixed at the third and fourth test mixers 960 and 962 in accordance with the test surround 
mix coefficients ms' and mi' to generate the test mixer 950 output channel information RSO- 
Reum and RSO-Imum respectively. 

[93J The controller 940 may further be coupled with the test downmixer 104', and 
the first, second, third and fourth test mixers 956, 958, 960 and 962. The controller 940 may 
be capable of receiving one or more of the LI, CI, RI, LFE. LSI and RSI channel information 
of the input signal, and determming limited-bandwidth (i.e., filtered) channel information, for 
example, LSIum and RSItim for use in the test downmixer 950. The controller 940 may 
further be capable of receiving output channel information, for example the output channel 
information LO and RO from the full-bandwidth downmixer 901, and/or the limited- 
bandwidth output channel information LSO-IMum, LSO-RELim, RSI-REum and RSI-IMum 
channel information from the test downmixer 950, and generating one or more mix 
coefficients, for example, the mix coefficients ml, mr, mi and ms using the test downmixer 
950, as described below. The controller 940 may further be coupled with a storage device 
942 providing a working memory and a program memory for the controller 940. Operation 
of the downmixer 900 will be discussed with reference to the flow chart of Figure 10. 

[94] Figure 10 is a flow chart illustrating operation of the downmixer 900 of Figure 
9. As shovm in Figure 10, input channel information is received 1000, for example, 
including information for the LSI, LI, CI, LFE, RI and RSI channels of the input signal. One 
or more mix coefficients may be generated 1002 using the controller 940 and the test 
downmixer 950, responsive to at least one of the input channel information as will be 
described below with reference to Figures 11-13 and 14-1 7. The LI, CI, LFE and RI channel 
information, may be mixed 1004 in a similar fashion as discussed above with respect to 
Figure 3 and Figures 4-6. Further, information of the LFE channel may be amplified, for 
example, by a factor of two, before being mixed at the first LI and RI mixers 902 and 904, 
respectively. Additionally, the CI channel information may account for one or more mix 
coefiHcients, for example, front left and right channel mix coefficients ml and mr, using the 
multipliers 906 and 908, before the CI channel information is mixed at the first LI and RI 
mixers 902 and 904. The first LI mixer 902 generates LP channel information and the first 
RI mixer 904 generates RI' channel information. For example, the LP and RI' channel 
information may be utilized as a left and right output signal for the purpose of generating the 
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mix coefficients ml and nir, in a similar fashion as discussed above with respect to Figures 3- 
11. 

[95] Components of the LSI and RSI channels may be added 1 006 to the LP and 
RJ' channel information using the second LI mixer 910 and second RI mixer 914, 
respectively. For example, LSI channel information may be multiplied with a mix coefficient 
ms at multiplier 919, before being mixed with the LP channel information at the second LI 
mixer 910. Similarly, the RSI channel information may be multiplied by a mix coeflBcient 
ms at a multiplier 919 before being mixed with the RI' channel information at the second RI 
mixer 914. Any desired phase shift for the front channel information may be provided 1008, 
by the LI phase shifter 912 and the RI phase shifter 916, to form LO' and RO' channel 
information respectively, 

[96] Concurrently with, or subsequent to the mixing 1004, adding 1006 and 
providing 1008, components of the RSI and LSI channels may be added 1010 to one another. 
For example, the RSI channel may be inverted at an inverter 927, and multiplied at a 
multiplier 928, by a cross-correlation factor, for example, -0.38, and mixed with the LSI 
channel information at the LSI mixer 918. Before mixing at the LSI mixer 918, the LSI 
channel information may be attenuated by some factor, for example 0.91 at a multiplier 929. 
In a similar fashion, a component of the LSI channel may be added to the RSI channel using 
a multiplier 931, by multiplying the LSI channel information by a cross-correlation factor, for 
example -0.38, and mixed with the RSI signal at the RSI mixer 930. Before mixing at the 
RSI mixer, the RSI channel may be attenuated by a factor, for example 0.91, at a multiplier 
933. 

[97] A respective mix coefficient may be accounted for by multiplying 1012 the 
channel information from respective LSI mixer 918 and RSI mixer 930 by the mix coefficient 
mi to form the LSP and RSP channel information respectively. 

[98] Any desired phase shift may be provided 1014 for the surround channels. For 
example, a phase shift may be provided to the LSP channel information at the LSI phase 
shifter 924 to form the LSO* channel information, where the phase is offset by 90 degrees 
with respect to that provided by the LI phase shifter 912. Similarly, the RSP channel 
information may be shifted in phase at the RSI phase shifter 934 to form the RSO' channel 
information, where the phase shift is offset by 90 degrees with respect to that applied by the 
RI phase shifter 916. 
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[99] The surround channel information and front channel information may then be 
mixed 1016. For example, the LSO' channel information may be mixed with the LO' channel 
information at the LO mixer 936 to form the LO channel of the output signal, and the LO 
channel may be provided 1018. Similarly, the RSO* channel information may be mixed with 
5 the RO' channel information at the RO mixer 938 to form the RO channel of the output 
signal, and the LO channel may be provided 1018. 

[100] Although the generating 1002 mix coefficients has been shown at a particular 
location in the flow chart of Figure 10, it will be apparent that one or more mix coefficients, 
for example ml, mr, mi, and ms may be generated by the controller 940 at any time during 

10 operation of the downmixer 900. Further, the mix coefficients need not all be generated at 
the same time, and may be generated at different times during operation of the downmixer 
900. The front left and right channel mix coefficients ml and mr may be generated using the 
controller 940 and the test dovmmixer 104' in a similar fashion as discussed above with 
respect to Figure 3 and Figures 4-6, and will not be discussed in detail. In addition, the mix 

15 coefficient generation for the front channel mix coefficients ml and mr may be accomplished 
independently from the mix coefficient generation of the surround mix coefficients mi and 
ms. 

[101] The generation of the surround mix coefficients mi and ms may be generated 
by the controller 940 using the test mixer 950, for example, as discussed with respect to the 

20 flow chart of Figure 3, and the flow charts of Figures 1 1-13 and 14-17. As shown in 

Figure 3, at least one of an input and an output channel energy is determined 300. At least 
one of the input and output channel energy determination 300 will be discussed with respect 
to the flow chart of Figure 11. 

[102] Figure 1 1 is a flow chart illustrating operation of the controller 940 in 

25 determining input channel energy, used in generation of at least one test surround mix 

coefficient, for example, test surround mix coefficients mi' and ms'. As shown in Figure 1 1, 
input channel information for the LSI and RSI channels are received 11 00 at the controller 
940, for example as signal samples of the input signal, in a similar fashion as discussed above 
with respect to the receiving 400 of Figure 4. 

30 [103] The input channel information may be filtered 1 102 by the controller 940 to 

generate limited-bandwidth input channel information LSlum and RSIum channel 
information. For example, the input channel information may be filtered 1 102 utilizing a 
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finite impulse response filter, for example, emphasizing frequencies and the 700-4000 Hz 
frequency range, in a similar fashion as discussed above with respect to filtering 402 of 
Figure 4. 

I104J Limited-bandwidth output channel information may be determined 11 04 at the 
5 test downmixer 950 as LSO real and imaginary channel information, LSO-Reym and LSI- 
Imum, and RSO real and imaginary channel information, RSO-Re um and RSO-Im um, as 

LSO-Reum = ms* * LSIum (eqn. 23) 

LSO-Imum = mi» * (0.91 ♦ LSIum + 38 * RSIum) ' (eqn. 24) 

RSO-Reum = ms' * RSIum, and (eqn. 25) 

10 RSO-Imum = mi' * (-.91 * RSIum - .38 * LSIum), (eqn. 26) 

where ms' and mi' are initialized to a value of 0,7, A limited-bandwidth input channel 
energy may be determined 1 106 by the controller 940 for LSI energy and RSI energy, as 
ELSlLim and ERSlLim, respectively, where 

ELSIum = ELSl\ini> and (eqn. 27) 

15 ERSIum = ERSl\im. (eqn. 28) 

[105] Limited-bandwidth output channel energy may be determined 1 1 08 by the 
controller 940, as real and imaginary components of LSO channel energy, ELSO-Re um and 
ELSO-Imum, respectively, and real and imaginary of RSO channel energy, ERSO-Reum and 
ERSO-ImLim, respectively, where 
20 ELSO-Reum = LSO-Re\im (eqn. 29) 

ELSO-Imum = LSO-Im\im (eqn. 30) 

ERSO-Reum = RSO-Re'um, and (eqn. 3 1 ) 

ERSO-ImLim = RSO-Im\i„,. (eqn. 32) 

[106] The limited-bandwidth input and output channel energy may be averaged 1110 
25 by the controller 940 in a similar fashion as discussed above, for example, with respect to the 
averaging 410, as LSI, RSI, LSO and RSO average energy ELSIsum, ERSIsum, ELSOsum, and 
ERSOsum, respectively, where 

ELSIsum = ELSIsum + ELSIum (eqn, 33) 

ERSIsum = ERSIsum + ERSIum (eqn. 34) 

30 ELSOsum = ELSOsum + ELSO-Reu„, + ELSO-Imum, and (eqn. 35) 

ERSOsum = ERSOsum + ERSO-RcLim + ERSO-Imum- (eqn. 36) 
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[107) It may be determined 1 1 12 whether the averaging is complete. Where the 
averaging is not complete, flow returns to the receiving 1 100. Where it is determined 1 1 12 
that the averaging is complete, a total limited-bandwidth input and output channel may be 
determined 1 1 14 by the controller as EIn um and EOutum , respectively, as 
5 Elntim = ELSIsum + ERSIsum, and (eqn. 37) 

EOutum = ELSOsum + ERSOsum. (eqn. 38) 

[108] Returning to Figure 3, upon determining 300 at least one of the input and 
output channel energy, a feedback constant may be determined 302. The determining 302 of 
the feedback constant will be discussed with respect to the flow chart of Figure 12. 
^0 [109] Figure 12 is a flow chart illustrating operation of the controller 940 in 

determining a feedback constant fbsi that may be used in determining a test mix coefFicient(s) 
for the test downmixer 950, for example, the test surround channel mix coefficients mi' and 
ms'. As shown m Figure 12, the limited-bandwidth input and output energy, for example, 
determined at 1 1 14, may be filtered 1200 by the controller 940 to form filtered input and 
15 output limited-bandwidth energy SINum and SOUTum, as 

SINum - .98 * SINum + .02 * EINum, and (eqn. 39) 

SOUTLim = .98 * SOUTum + .02 * EOUTum. (eqn. 40) 

Such filtering may be low pass filtering, and may be accomplished utilizing a filter having, 
for example a 70ms time constant. Other time constants may be utilized. 
20 [110] A feedback constant fbsi may be determined 1202 by the controller 940, as 

fbsi = .98 * fbsi + gfb * ((SOUTum / SINum) - 1), (eqn. 41) 

where gfb has a value of 0.04. Considerations for a value of gfb to be used may be similar 
to as discussed above with respect to the generation 504 discussed above with respect to 
Figure 5. Upon determining 302 the feedback constant, one or more test surround mix 
25 coefficients may be generated 304 by the controller 940, as will be described with respect to 
Figure 13. 

[Ill] Figure 13 is a flow chart illustrating operation of the controller 940 when 
generating test surround mix coefficients for the downmixer 900, for example the test 
surround channel mix coefficients mi' and ms*. As shown in Figure 13, it is determined 1300 
30 whether a value of the feedback constant fbsi, determined at 1202, is greater than or equal to 
zero. Where the feedback constant is not greater than or equal to zero, a value of the test 
surround mix coefficient ms* is set by the controller 940 at 1302, to a value of 
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ms' = 0-fbsi, (eqn.42) 
and a value of the test mix coefficient mi' is set at 1304 to a value of 1 . However, where it is 
determined 1300 that the feedback constant is greater than or equal to zero, a value of ms' is 
set at 1306 to zero and at 1308, a value of mi' is set to 

mj' = l-fbsi. (eqn.43) 
Where mi' is less than zero, mi* is reset at 1310 to a value of zero. 

[112] After generating the test mix coefficients mi' and ms', the test surround mix 
coefficients mi' and ms' may be utilized by the controller to update the surround mbc 
coefficients mi and ms used by the full-bandwidth downmixer 901. The updating 1312 may 
be accomplished in a similar fashion as described above, for example with respect to the 
updating 608 of Figure 6. 

[113] The mix coefficient mi may be utilized in the downmixer 900 to attenuate one 
or both of the surround channels, for example, when the LSI or RSI channels are driven 
together by the same signal. The surround mix coefficient mi may be adjusted by a small 
feedback loop to keep the input power and the output power substantially equal. The 
surround mix coefficient ms may be utilized, for example, to bypass the 90 degree phase 
shifters 924 and 934, where ms may control an amount of cross-mixed surround signal that is 
added to the front channels, for example, in situations where LSI and RSI are out of phase. 
Where ms has a positive, non-zero value, a coherent signal of the surround input channels 
may be provided in both the 90 degrees phase-shifted path and the non-90 degree phase 
shifted patiti of the downmixer 900. 

[114] In at least some circumstances, it may be desirable to make modifications/ 
adjustments to one or more of the surround mix coefficients, for example the surround mix 
coefficients mi and ms determined with respect to Figure 13, before or during the time they 
are used by the downmixer 900. As with the generating of the front channel mix coefficients 
ml and mr, the surround channel mix coefficient(s) mi and ms are typically generated in a test 
downmixer environment. By utilizing the test downmixer for generating one or both of the 
mix coefficients mi and ms, the coefficients may be additionally modified/adjusted before 
being used in a full frequency range downmixer, where values for mi and ms may be kept in 
the test downmixer to not disturb the feedback. 

[115] Values of one or both of the surround mix coefficients mi and ms may be 
adjusted to create a two-channel downmix that is subjectively closer to the original five- 
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channel downmix by altering an energy ratio between the front channels and the rear 
channels in an active manner. Such modifications may adjust for a situation where there is 
too much reverberation in the surround channels. A ratio of the energy in the front channels 
and the surround channels, F/S, may be utilized to adjust the mix coefficients mi and ms. The 
5 adjustments may include reducing at least one or both of mi and ms by some amount, for 
example, corresponding to 3dB of the LSI and/or RSI channel information, where a F/S ratio 
is greater than 1, as discussed below. Further, in some situations, it may be desirable to 
actively look for audible sound elements (i.e., non-reverberation sound information) in one or 
more of the input channels, for example, in one or both of the surround channels LSI and 

10 RSL When audible sound elements are present, the 3dB attenuation applied to the mix 
coefiBcients mi and ms may be removed. 

[116] In addition, the surround mix coefficients mi and ms may be adjusted to 
enhance various sound events, for example, to emphasize surround channel signals that may 
not be as strong as simultaneous signals occurring in the front channels received at the 

15 downmfacer 900. A sound event may be thought of as a directional transient, for example, 
sounds that have an initial energy spike, such as a shout or a drum hit, and where information 
about the transient direction is maintained (i.e., not blocked by an object). Two types of 
sound events may be syllables and impulsive sounds. Syllables may include phonemes and 
notes. Phonemes are transient sounds that are characteristic of phones in human speech and 

20 that can be particularly useful in detecting and localizing syllables in human speech. Notes 
are individual notes created by a musical mstrument. Because notes and phonemes have a 
common characteristic, they may be collectively referred to as "syllables". Syllables, 
generally have the following characteristics: a finite duration of approximately at least 50 ms 
up to approximately 200 ms, but typically around 150 ms; rise times of approximately 33 ms; 

25 generally occur no more frequently than approximately once every 0.2 ms to approximately 
0.5 ms; and may have low or high volume (amplitude). In contrast, impulsive sounds may be 
transients of very short duration such as a drum hit or frictives, and explosives in speech. 
Impulsive sounds generally have the following characteristics: a short duration of 
approximately 5 ms to approximately 50 ms, rise times of approximately 1 ms to 

30 approximately 10 ms, and a high volume. 

[117] A sound event may be detected, for example, as described in conmionly- 
assigned U.S. Patent Application No. (not yet assigned), entitled "Sound Event Detection", to 
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David H. Griesinger, filed May 2, 2003 as Attorney Docket No. 1 1336/208, and is 
incorporated by reference herein. For example, a rate of increase in an input energy level at 
one of the input channels may be utilized to detect the start of a sound event. For example, a 
rate of increase in one or both of the LSI and RSI channels may be detected, where a value of 
5 the mix coefficients mi and/or ms may be adjusted to allow the sound event to be more 
prominent in the two channel mix than if signal power were completely preserved. For 
example, any 3dB attenuation applied to combat a detected reverberation signals in one or 
more of the input channels may be removed. The sound event detector may be utilized in 
conjunction with any of the input channels, and the presence of a significant sound event in a 

10 particular input channel may be used to trigger a temporary boost of the level in that channel. 
The boost may be accomplished by Increasing a value for one or more mix coefficients, for 
example, the mix coefficients mi and ms. Such a boost may last, for example, 100 to 300 ms. 
Further, the boost may be, for example, a boost corresponduig to a gain of 1 - 3dB of the 
corresponding channel information for enhancing the audibility of low level sound events in 

15 the resulting downmix. 



coefficient(s). 

[119] Figure 14 is a flowchart illustrating operation of the controller 940 in adjusting 
one or more mix coefficients, for example, the surround mix coeflRcients mi and ms. As 

20 shown in Figure 14, input channel energy is determined 1400. The determining 1400 of the 
input channel energy is discussed below with respect to the flowchart of Figure 15. Upon 
determining 1400 the input channel energy, one or more mix coefficients, for example mi and 
ms, may be adjusted 1402. Mix coefficient adjusting 1402 is discussed below with respect to 
the flowcharts of Figures 16-17. 

25 [120] Figure 1 5 is a flowchart illustrating operation of the controller 940 in 

determining 1400 the input channel energy. Input channel information is received 1500, and 
may include information regarding the LI, RI, CI, LSI, and RSI channels of the input signal. 
A front input channel energy may be determined 1502 for the LI, CI, and RI channels as ELI, 
ECI, and ERI, where 



[1 18J Figures 1 4- 1 7 are flowcharts illustrating adjustment of surround mix 



30 



EU = LI^ 
ECI = CI^ and 
ERI = RI^ 



(eqn. 44) 
(eqn. 45) 
(eqn. 46) 
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[121] The IP channel information may be received 1500 in a similar fashion as 

discussed above with respect to the receiving 400 of Figure 4. A totaJ front input channel 

energy may be determined 1504 as EFI, where 

EFl = ELI + ECI +ERI. (eqn. 47) 

5 [122] A surround input channel energy may be determined 1 506 for a LSI channel 

and a RSI channel as ELSI and ERSI respectively, where 

ELSI=LSI^a^d (eqn. 48) 

ERSI = RSI^ (eqn, 49) 

[123] A total surround input channel energy, ESI, may be determined 1508, as 
10 ESI = ELSI + ERSI. (eqn. 50) 

[124] The front and surround input channel energy may be averaged 1510 as EFIsum 

and ESIsum, respectively, where 

EFIsum = 0.9*EFIsum + 0. 1 *EFI, and (eqn. 5 1 ) 

ESIsum = 0.9*ESIsum + 0.1 *ESI. (eqn, 52) 

1 5 [125] The averaging 1510 may be accomplished in a similar fashion as discussed 

above, for example, with respect to the averaging 410 of Figure 4. 

[126] It may be determined 1512 whether the averaging is complete. Where the 

averaging is not complete, the flow returns to the receiving 1500 input channel information 

and continues as discussed above. Where it is determined 1512 that the averaging is 
20 complete, the front and surround input channel averages are filtered 1 5 14 as EFIum and 

ESlLim* where 

EFlLin. = 0.99*EFlLim + 0.01 *(EFIsum)., and (eqn. 53) 

ESlLim = 0.97*ESIum + 0.03*(ESIsum). (eqn. 54) 

[127] Once the input channel energy is determined 1400, the mix coefficients may 
25 be adjusted 1402 as described with respect to the flowcharts of Figures 16 and 17, 

[128] Figure 16 is a flowchart illustrating operation of the controller 940 in adjusting 
1402, one or more mix coefficients, for example the surround mix coefficients mi and ms. 
As shown in Figure 16, a surround energy boost factor, SBF, may be generated 1600 as 

SBF = 3*ESI - 2*ESIu.n. (eqn. 55) 

30 [129] It may then be determined whether the average surround energy, ESItim, is 

rising. This is accomplished by determining 1602 whether the average surround energy is less 
than the surroimd energy boost factor. Where it is determined that the average surround 
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energy is less than the surround energy boost factor, the average surround energy may be 
averaged 1604 using a first time constant, for example as 

ESIsum = 0.99*ESIsum + 0.0 1 *SBF. (eqn. 56) 

The first time constant may be, for example, approximately 1 50 ms. 

(130) However, where it is determined 1602 that the average surround energy is not 
less than the energy boost factor, the average surround energy may be averaged 1606 using a 
second time constant, as 

ESIsum = 0.999*ESIsum + 0.001 SBF, (eqn. 57) 

where the second time constant may be, for example, approximately, 1.5 seconds. 

[131] The average surround input energy may then be averaged responsive to a 
current value of the surround input energy. This may be accomplished, for example, by steps 
1602, 1604, and 1606, 

1132] A front/back energy ratio, F/S, may be determined 1608 as an energy ratio 
between the average front channel and average surround channel input energies, as 
15 F/S - (EFIsum+ 1) / ((1 .2*ESIsum)+l). (eqn. 58) 

The front/surround energy ratio may be a bias to the surround input channel, by for example, 
1.2 dB. Further, the front/surround energy ratio may be constrained within a range of O.I and 
10. For example, where the front/surround power ratio is greater than 10, the front/surround 
energy ratio may be set to a value of 10. Where the front/surround energy ratio is less than 
20 0.1, the front/surround energy ratio may be set to a value of 0.1. 

[133] The mix coefficients mi and ms may determined responsive to the 
front/surround energy ratio. This may be accomplished by determining 1610 whether the 
front/surround energy ratio is greater than a value of 4. Where the front/surround energy 
ratio is greater than 4, the mix coefiRcients ms and mi may be set at 1612 and 1614 to 
25 ms = 0.71 *ms, and (eqn. 59) 

mi = 0.71*mi. (eqn. 60) 

[134] However, where it is determined 1610 that the front/surround energy ratio is 
not greater than 4, it may be determined 1616 whether the front/surround energy ratio is 
greater than or equal to a value of 2, and less than or equal to a value of 4. If the 
30 front/surround energy ratio is greater than or equal to 2 and less than or equal to 4, tiie mix 
coefficients ms and mi may be set 1618 and 1620, respectively, as 

ms = 0.8 - 0.045 *(F/S-2), and (eqn. 61) 
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mi = 0.8 - 0.045*(F/S-2). (eqn. 62) 

[135] If however, it is determined 1616 that the front/surround energy ratio is not 

greater than or equal to 2 and less than or equal to 4, the mix coefficients ms and mi may set 

1622 and 1624, as 

ms = 1-0.2*(F/S-1). and (eqn. 63) 

mi=l-0.2*(F/S-l). (eqn. 64) 

[136] Further, the values for the mix coefficients, for example the surround mix 
coefficients mi and ms may be adjusted responsive to an increase in surround channel input 
levels as a surround channel level increase ratio, S/I. Adjustments to the mix coefficients mi 
and ms responsive to the rear surround channel input level is discussed with respect to the 
flowchart of Figure 17. 

[137] Figure 17 is a flowchart illustrating operation of the controller 940 in adjusting 
one or more mix coefficients, for example the surround mix coefficients mi and ms, in 
response to a rear surround input energy level ratio SA. As shown in Figure 17, a rear 
surround input energy ratio, S/I, is generated 1700, where 

S/I-SBF/ESIum, (eqn. 65) 

where the surround energy boost factor is as detenmined with respect to Figure 16, and the 
ESIum is as determined with respect to Figure 15. It is then determined 1702 whether a 
second surround boost factor indicators, SBF2 is less than the surround input energy ratio. 
Where the second boost factor is less than the energy ratio, the second surround boost fector 
is set 1704 as 

SBF2 = 0.8SBF2 +0,2 S/I, (eqn. 66) 

[138] However, where the second surround boost factor is not less than the surround 
input energy ratio, the second surround boost factor indicator may be set 1706 as 

SBF2 = 0.97SBF2 + 0.03 S/I (eqn. 67) 

where the second surround boost factor 1704 represents a time constant of approximately 7 
ms, and the second boost factor at 1706 represents a time constant of approximately 70 ms. 

[139] The second surround boost factor indicator may be scaled responsive to F/S. 
This is accomplished, by determining 1708 whether F/S is less than 0.6. Where F/S is less 
than 0.6, the surround boost fector indicator SBF may be scaled as 

SBF2 = SBF2*(S/I* 1 .8). (eqn. 68) 
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However, where it is determined 1708 that F/S is not less than 0.6, it may be determined 1712 
whether F/S is greater than 1 .8. Where F/S is greater than 1 .8, the second surround boost 
factor may be scaled 1714 as 

SBF2 = SBF2/(S/I*0.6). (eqn. 69) 

5 [1401 Where the second surround boost factor has been scaled 1710 or 1714, or 

where it is determined 1712 that F/S is not greater than 1.8, it may be determined 1716 
whether the F/S is greater than 1.3. Where it is determined 1716 that the F/S is greater than 
1.3, the second surround boost ^tor may be scaled 1718 to a value of 1.3. Where the second 
surround boost factor is scaled 1718, or where the F/S is determined not to be greater than 
10 1.3, it may be determined 1720 whether the F/S is greater than 1 . 

[141] Where it is determined 1 720 that the F/S is greater than 1, the second surround 
mix coefficients ms and mi may be set 1722 and 1724 as 

ms = ms*SBF2, and (eqn. 70) 

mi mi*SBF2. (eqn. 71) 

15 [142] Where the surround mix coefficients ms and mi have been set 1 722 and 1 724 

or where it is determined 1720 that the F/S is not greater than 1, flow may return to the 
receiving input channel information 1 100 and continue as discussed with respect to Figure 
11. 

[143] Although the adjustment/modification to mix coefficients has been discussed 
20 as occurring after generating mix coefficients that may be utilized in a downmixer for 

substantially preserving energy and intended direction of an input signal at the output signal, 
it will be apparent that the mix coefficient adjustments discussed with respect to Figures 14- 
16 may be made independent of mix coefficient generation discussed with respect to Figures 
4-6 and/or Figures 11-13, Further, the mix coefficient adjustments made with respect to 
25 Figures 14-17 may be made at particular intervals, for example, at every 64 seimples of audio 
signal information processed at the downmixer, where, for example, an overall sampling rate 
of the input signal is 44,100 samples per second. Other particular periods may be utilized for 
adjusting/modifying mix coefficients. Further, the downmixer may be capable of processing 
audio signals at sampling rates other than 44,100 samples per second. 
30 [144] Although the downmixers 100 and 900 have been described as downmixers or 

downmixing input signals having 3 input channels and 5.1 input channels to output signals 
having 2 output channels respectively, it will be apparent that the teachings described above 
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may be applied to a downmixer for mixing an input signal having any number of input 
channels to an ou^ut signal having a number of output channels less than die number of 
input channels. The downmixers 100 and 900 may be implemented on one or more 
microprocessors executing suitable programmed code stored in internal memory of the 
5 microprocessor and/or the storage device 120 and 942 respectively. For example, the 

microprocessorCs) may be sufficiently programmed for, and possess processing capabilities 
and other hardware requirements, for allowing the microprocessors to provide the 
functionalities described herein with respect to the downmixers 100 and 900. Further, the 
microprocessors may be capable of providing any digital signal processing, filtering or other 

10 functionalities in caring out the downmixing described herein. 

[145] The test mixers may be utilized in generating mix coefficient values at all 
times while the downmixer 100 or 900 is operating. The controller, using a test mixer, for 
example, test mixer 104 or test mixer 950, may constantly monitor input and output energy, 
and determine one or more mix coefficient values when appropriate to allow signal energy 

15 and intended direction of fee input signal to be substantially preserved at the output signal. 
Alternatively, the controller 106 may monitor the input and output signal energies at the full- 
bandwidth downmixer, and invoke the test downmixer to generate mix coefficient values in 
circumstances when the full bandwidth output energy is not equal to the full bandwidth input 
energy. 

20 [146] Although front channel and surround channel mix coefiScient values have been 

described as being generated using test mixers, for example, test mixer 104 and test mixer 
950, respectively, it will be apparent that mix coefficient values may be determined using the 
full-bandwidth downmixer, while the downmixer is downmixing the input signal to the 
output signal. In this circumstance, a test mixer may not be needed or provided. For 

25 example, the controller 106 may determine the input energies of the full-bandwidth input, and 
fuli-bandwidth output signals of the fiill-bandwidth downmixer, and generate and/or update 
mix coefficient values utilizing this fuII-bandwidth energy in a similar fashion as described 
above with respect to Figures 4-6 and 11-13 for limited-bandwidtii energies. In addition, 
although the test downmixer 950 is described as being utilized with a 5.1 to channel 

30 downmixer, it will be apparent that the test downmixer 950 may be utilized for generating 
surround mix coefficient values that may be utilized in any downmixer having surround 
channel downmixing capabilities. 
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[147] A downmixer is provided capable of generating mix coefficients such that 
energy and intended direction of the input signal is substantially preserved at the output 
signal. Such mix coefficient generation may be accomplished, for example, in a test 
downmixer, where values for mix coefficients may be updated to a non-test downmixer, for 
example a full-bandwidth downmixer. The test downmixer may operate on limited- 
bandwidth input channel information, such that mix coefficient values may be generated that 
accentuate the substantially audible frequencies that are perceivable by human listeners. 
Further, the downmixer may be capable of adjusting mix coefficient values, responsive to a 
ratio of energy at some combination of a plurality of the input channels (i.e., a ratio of front 
channel energy to rear channel energy, etc. . .). The mix coefficients may be adjusted, for 
example, to emphasize detected beginnings of sound events, such as notes from an 
instrument, or syllables in speech, when downmixing the input signal In addition, or in the 
alternative, the mix coefficient values may be adjusted to provide a more accurate rendition 
of reverberation of the input signal at the output signal. In addition, the downmixer may be 
capable of preserving intended du^ction of a input signal when the downmixed signal is later 
upmixed, for example, at a decoder. The decoder may be capable of determining that 
surround channel information that has been downmixed in accordance to at least some of the 
teachings described herein is surround channel information that may be upmixed as surround 
channel information. 

[148] The downmixers 100 and 900 are typically implemented as programming 
executed on one or more microprocessors for carrying out the functionalities described 
herein. However, it will be apparent that the downmixers may be implemented using any 
combination of hardware devices and/or programming executed on one or more 
microprocessors to carry out the functionalities described herein. 

[149] Similarly, the controllers 106 and 940 may be comprised of any combination 
of hardware devices designed for specific functionalities (including, for example, applications 
specific integrated circuits capable of providing functionalities such as filtering, mixing, and 
alike). The controllers 106 and 940 may be comprised of a microprocessor(s) executing 
programmed code to achieve the functionalities described with respect to the controllers 106 
and 940. 

[150] The storage device 120 and the storage device 942 may comprise one or more 
fixed or removable storage devices including, but not limited to, solid state media, magnetic 
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and optical media. The solid state media may include, but is not limited to, integrated circuits 
such as ROMs, PROMs, EPROMs, EEPROMs, and any type of RAM, as well as removable 
memory stor^e devices such as a flash media card, and any derivative memory systems of 
these devices. The magnetic media may include, but is not limited to, magnetic tape, 
5 magnetic disks such as floppy diskettes and hard disk drives. The optical media may include, 
but is not limited to, optical disks such as a Compact Disc and a Digital Video Disc. 
Typically, the storage devices 120 and 942 include working memory (RAM) portion, and a 
program memory portion for storing programmed code for any microprocessors 
implementing the fijnctionalities described herein. Further, the storage devices 120 and 942 

10 may further include a sufficient storage medium for storing, for example, mix coefficient 
tables for downmixing the input signal to Ae output signal, described above. 

[1511 Although the downmixers 100 and 900, and specifically the controllers 106 
and 940, have been described as averaging input and output signal energies over a particular 
time period, for example, the first time period, it will be apparent that the averaging may be 

15 accomplished over other time periods. Further, it will be apparent that at least some of the 
advantages discussed above may be achieved where the input and/or output signal energy is 
not averaged. 

[152] Further, although it has been described that the one or more mix coefficients 
are generated in a test mbcer, it will be apparent that a test mixer need not be provided, where 
20 the mix coefficients may be generated and/or adjusted during operation of the full-bandwidth 
downmixers 102 and 901 while the respective full-bandwidth downmixer is downmixing the 
input signal to the output signal, while achieving at least some of the advantages discussed 
above. 

[153] While various embodiments of the invention have been described, it will be 
25 apparent to those of ordinary skill in the art that many more embodiments and 

implementations are possible within the scope of the invention. Accordingly, the invention is 
not to be restricted except in light of the attached claims and their equivalents. 
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Claims 

What is claimed is: 

1. A method of generating mix coefficients for downmixing a multi-channel input signal 
5 having a plurality of input channels, to an output signal having a plurality of output channels, 

comprising: 

determining an input energy at a plurality of input channels of the input signal; and 
generating at least one mix coefficient responsive to the input energy where the input 
signal energy, and the apparent direction of the input signal are substantially preserved in the 
10 output signal. 

2. The method of Claim 1, further comprising: 

determining an output energy for at least one of the output channels; 

where the generating at least one mix coefficient includes generating at least one mix 
15 coefficient responsive to the deteimining the input energy and the determining output energy 
where the input signal energy, and the apparent direction of the input signal are substantially 
preserved in the output signal. 

3. The method of Claim 2, further comprising: 

20 generating a feedback constant responsive to the input and output energy; 

where the generating at least one mix coefficient includes generating at least one mix 
coefiHcient responsive to the feedback constant. 

4. The method of Claim 3, where the generating the feedback constant includes 
25 generating the feedback constant responsive to a ratio of the output energy to the input 

energy. 

5. The method of Claim 3, where the generating the feedback constant includes 
averaging the feedback constant. 
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6. The method of Claim 3, where: 

determining the input energy includes averaging the input energy over a first time 
period, and determining the output energy includes averaging the output energy over the first 
time period; and 

generating the feedback constant includes averaging the feedback constant over a 
second time period. 

7. The method of Claim 6, where the second time period includes a plurality of iterations 
of the first time period. 

8. The method of Claim 2, further comprising: 

determining at least one of a left input channel, center input channel, and right input 
channel of the input signal; and 

determining a left output channel and a right output channel of the output signal, the 
left output channel energy determined responsive to at least one of the left and center input 
channel, and the right output channel energy determined responsive to at least one of the right 
and center input channel; 

where 

determining the input energy includes determining the input energy responsive 
to at least one of the left, center and right input channels, and 

determining the output energy includes determining an output energy 
responsive to at least one of for at least one of the left output channel and a right output 
channel. 

9. The method of Claim 8, further comprising: 

generating at least one feedback constant responsive to at least one of the input and 
output energy; 

where generating at least one mix coefficient includes generating at least one mix 
coefficient responsive to the at least one feedback constant. 

10. The method of Claim 9, where: 
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determining the input energy includes determining at least one of a left channel total 
input energy responsive to at least one of the left and center input channels, and a right 
channel total input energy responsive to at least one of the right and center input channels; 

determining the output energy includes determining at least one of a left output 
5 channel energy responsive to at least one of the left and center input channels, and a right 
output channel energy responsive to at least one of the right and center input channels; and 

generating at least one feedback constant includes generating a left channel feedback 
constant responsive to at least one of the left channel total input energy and the left channel 
output energy, and generating a right channel feedback constant responsive to at least one of 
10 the right channel total input energy and the right channel output energy; 

where generating at least one mix coefTicient includes generatmg at least one mix 
coefiTicient responsive to at least one of the left and right channel feedback constants. 

1 1 . The method of Claim 10, where the generating at least one mix coefficient includes: 
15 generating a left channel mix coefficient responsive to at least one of the left channel 

feedback constant and the ri^t channel feedback constant; and 

generating a right channel mix coefficient responsive to at least one of the left channel 
feedback constant and the right channel feedback constant. 

20 12. The method of Claim 10, where: 

generating a left channel feedback constant includes generating the left channel 
feedback constant responsive to a ratio of the left channel output energy to the left channel 
total input energy; and 

generating a right channel feedback constant includes generating the right channel 
25 feedback constant responsive to a ratio of the right channel output energy and the right 
channel total input energy. 

13. The method of Claim 10, where: 

determining the left and right channel total input energy and determining the left and 
30 right channel output energy includes averaging the left and right channel total input energy 
and the left and right channel output energy over a first time period; and 
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generating the at least one feedback constant includes averaging the at least one 
feedback constant over a second time period. 

14. The method of Claim 13, where the generating at least one mix coefficient includes 
5 averaging at least one mix coeflRcient over the second time period. 

15. The method of Claim 13, where the second time period includes a plurality of 
iterations of the first time period. 

10 16. The method of Claim 10, where: 

determining the input energy includes determining a low frequency input channel of 
the input signal; and 

determining the left and right channel total input energy includes determining at least 
one of the left and right channel total input energy responsive to the low fi^quency input 
IS channel. 

17. The method of Claim 10, where the input energy is a fi-ont channel input energy, the 
output energy is a front channel output energy, and the at least one generated mix coefficient 
is at least one front channel mix coefficient, and further comprising: 
20 determining at least one of a left surround input channel and a right surround input 

channel; 

determining at least one of a left surround output channel and a right surround output 
channel, the left surround output channel determined responsive to at least one of the left 
surround input channel and the right surround input channel, and the right surround output 
25 channel determined responsive to at least one of the left surround input channel and the right 
surround input channel; 

where 

determining the input energy includes determining a surround input channel 
energy responsive to at least one of die left and right surround input channels, 
30 determining the output energy includes determining a surround output channel 

energy responsive to at least one of the left surround output channel and a right surround 
output channel, and 
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determining at least one mix coefficient includes determining at least one 
surround mix coefficient, such that the apparent direction of the input signal is substantially 
preserved in the output signal, the front channel input energy is substantially equal to the 
front output energy, and the surround input energy is substantially equal to the surround 
5 output energy. 

18. The method of Claim 17, further comprising: 

phase shifting at least one of the left and right surround output channels by 90 degrees 
to generate a respective left surround phase-shifted output channel and right surround phase 
10 shifted output chaimeL 

19. The method of Claim 1 8, further comprising: 
mixing at least one of 

the phase-shifted left surround output chaimel with the left output channel, and 
15 the phase-shifted right surround channel with the right output channel; and 

forming at least one of 

a left output channel of the output signal responsive to mixing phase-shifted 
left surround output channel with the left output channel, and 

a right output channel of the output signal responsive to the mixing of the 
20 phase-shifted right surround chatmel with the right output channel. 

20. The method of Claim 8, where the determining the left, center and right input 
channels includes filtering the left, center and right input channels, and further including: 

determining limited-bandwidth left input channel energy responsive to at least one of 
25 the limited-bandwidth left and center input channels; 

determining limited-bandwidth right input channel energy responsive at least one of 
the limited-bandwidth right and center channels; 

determining limited-bandwidth left output channel energy responsive to at least one of 
the limited-bandwidth left and center input channels; 
30 determining limited-bandwidth right output channel energy responsive to at least one 

of the limited-bandwidth right and center input channels; 
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where generating at least one mix coefificient includes generating at least one mix 
coefficient responsive to at least one of the limited-bandwidth left input, right input, left 
output and right output channel energy. 

5 21. The method of Claim 20, where the filtering the left, center and right input channels 
includes band-pass filtering the left, center and right input channels. 

22. The method of Claim 21, where the band-pass filtering includes band-pass filtering in 
the 700 - 4000 Hz frequency band. 

10 

23. The method of Claim 2, further comprising: 

determining at least one of a left surround input channel of the input signal, and a 
right surround input channel of the input signal; and 

determining at least one of a left surround output channel and a right surround output 
15 channel of the output signal, the left surround output channel determined responsive to at 
least one of the left and right surround input channels, the right surround output channel 
determined responsive to at least one of the left and right surround input channels; 

where 

determining an input energy includes determining the input energy responsive 
20 to at least one of the left and right surround input channels, and 

determining an output energy includes determining the output energy 
responsive to at least one of the left and right surround output channels. 

24. The method of claim 23, further comprising: 

25 generating a feedback constant responsive to at least one of the input and output 

surround channel energy; 

where the generating at least one mix coefficient includes generating at least one mix 
coefficient responsive to the feedback constant. 

30 25. ITie method of Claim 24, further comprising: 
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determining a left surround output channel real portion and a left surround output 
channel imaginary portion of the left surround output channel; and 

determining a right surround output channel real portion and a right surround output 
channel imaginary portion of the right surround output channel; 
5 where 

determining the output energy includes determining the output energy 
responsive to at least one of the left surround real portion, left surround imaginary portion, 
right surround real portion, and right surround imaginary portion of the output signal, and 

generating at least one mix coefiGcient includes generating at least one of a 
10 surround-imaginary mix coefficient and a surround-real mix coefficient responsive to the 
feedback constant. 

26. The method of Claim 25, where generating at least one of the surround-imaginary and 
surround-reai mix coefficients includes generating at least one of the surround-imaginary and 

15 surround-real mix coefficients responsive to a value of the other of the surround-imaginary 
and surround-real mix coefficients. 

27. The method of Claim 26, where the generating at least one of the surround-imaginary 
and surround real mix coefficients includes: 

20 setting a value of the surround-real mix coefficient to zero when a value of the 

surround-imaginary mix coefficient is less than one. 

28. The method of Claim 26, where the generating at least one of the surround-imaginary 
and surround real mix coefficients includes: 

25 setting a value of the surround-imaginary mix coefficient to one when a value of the 

surround-real mix coefficient is greater than zero. 

29. The method of Claim 25, further comprising: 

determining at least one of a front left input channel, a front center input channel and 
30 a front right input channel; 

determining a front input channel energy responsive to at least one of the front left, 
center and right input channels; and 
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determining a surround channel input energy responsive to at least one of the left 
surround and right surround input channels; 

where the generating at least one of the surround-imaginary and surround-real mix 
coefficients includes generating at least one of the surround-imaginary and surround-real mix 
5 coefficients responsive to a front/surround energy ratio determined responsive to a ratio of 
the front input channel energy and the surround input channel energy. 

30. The method of Claim 28, where generating at least one of the surround-imaginary and 
surround-real mix coefficients responsive to the front/surround energy ratio includes reducing 

10 at least one of a value of the surround-real mix coefficient and a value of the surround- 
imagmary mix coefficient when the front/surround ratio is greater than one. 

3 1 . The method of Claim 25, further comprising: 
detecting a beginning of a sound event; 

15 where the determining at least one of the surround-imaginary mix coefficient and 

surround-real mix coefficient includes determining at least one of the surround-imaginary 
mix coefiRcient and surround-real mix coefficient responsive to the detection. 

32. The method of Claim 24, where the generating at least one feedback constant includes 
20 generating at least one feedback constant responsive to a ratio of the output channel energy to 

the input channel energy. 

33. The method of Claim 32, further comprising: 

filtering at least one of the input energy and the output energy; 
25 where generating the feedback constant includes generating the feedback constant 

responsive to at least one of the filtered input and output energy. 

34. The method of Claim 33, where: 

determining the input channel energy and determining the output energy includes 
30 averaging the input energy and output energy over a first time period; and 

generating the at least one feedback constant includes averaging the at least one 
feedback constant over a second time period. 
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35. The method of Claim 34, where the generating at least one mix coefficient includes 
averaging at least one mix coefficient over the second time period. 

5 36. The method of Claim 34, where the second time period includes a plurality of 
iterations of the first time period. 

37. The method of Claim 1, where generating at least one mix coefficient comprises 
retrieving at least one mix coefficient fi-om a storage device responsive to the input energy. 

10 

38. The method of Claim 37, where: 

determining at least one of a front left, front center and front right input channels of 
the input signal; and 

retrieving at least one mix coefficient includes retrieving at least one mix coefficient 
15 responsive to a panning angle between at least one of a front left and front center input 
channel, and a front right and front center input channel. 

39. The method of Claim 38, fiirther comprising: 

determining at least one of a front left channel input energy, a front center channel 
20 input energy and a front right channel input channel energy, the front left input channel 
energy determined responsive to the front left input channel, the front center input channel 
energy determined responsive to the front center input channel, and the front right input 
channel energy determined responsive to the front right input channel; 

determining a panning eingie between a front left and front center input channel 
25 includes determining the panning angle responsive to the front left and center input channel 
energy; and 

determining a panning angle between a front right and front center input channel 
includes determining the panning angle responsive to the front right and center input channel 
energy. 

30 
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40, The method of Claim 38, where the at least one generated mix coefficient is a front 
channel mix coefficient, and further comprising generating at least one surround channel 
coefficient responsive to the panning angle. 

5 41. The method of Claim 1 , further comprising generating the output signal responsive to 
at least one generated mix coefficient. 

42. The method of Claim 1, further comprising downmixing the plurality of input 
channels of the input signal to the number of channels of the output signal responsive to the 

10 at legist one generated mix coefficient. 

43. The method of Claim 42, where the generating the at least one mix coefficient 
includes generating at least one mix coefficient in a test downmixer environment, and the 
downmixing the plurality of input signals includes downmixing the plurality of input 

15 channels of the input signal to the number of output channels of the output signal ui a non- 
test downmixer environment. 

44. The method of Claim 1, where the number of input channels of the input signal is one 
of3, 5, 5.1 and 7. 

20 

45. The method of Claim 44, where the number of output channels of the output signal is 
2. 

46. The method of Claim 1, where the generating at least one mix coefficient includes 
25 generating at least one of a left front channel mix coefficient, a right front channel mix 

coefficient, a left surround channel mix coefficient, and a right surround channel mix 
coefficient. 

47. The method of Claim 1, where the generating at least one mix coefficient includes 
30 generating at least one mix coefficient by adjusting a mix coefficient determined in 

accordance with the Sine/Cosine pan law . 
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48. The method of Claim 1, where the generating at least one mix coefficient includes 
providing at least one of an upper value limit and a lower value limit for at least one of the 
generated mix coefficients. 

5 49. The method of Claim 1, where the generating at least one mix coefficient includes 
generating at least one mix coefficient in accordance with feedback techniques. 

50. The method of Claim 1, where the generating at least one mix coefficient includes 
generating at least one mix coefficient in accordance with feedforward techniques. 

10 

51. The method of Claim 1, where the plurality of input channels is equal in number to 
the plurality of output channels. 

52. The method of Claim 1, where the plurality of input channels is greater in number 
15 than the plurality of output channels. 

53. A downmixer for downmixing a multichannel input signal including a plurality of 
input channels to an output signal including a plurality output channels, comprising: 

an input signal source for receiving at least one of the input channels of the input 

20 signal; 

a controller coupled with the input signal source, capable of 

determining an input energy at a plurality of input channels of the input signal, 

and 

generating at least one mix coefficient responsive to the input energy where 
25 the input signal energy, and the apparent direction of the input signal are substantially 
preserved in the output signal. 

54. The downmixer of Claim 53, where the controller is further capable of: 
determining an output energy for at least one of the output charmels; 

30 where the generating at least one mix coefficient includes generating at least one mix 

coefiRcient responsive to the input energy and the output energy, such that the input signal 
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energy, and the apparent direction of the input signal are substantially preserved in the output 
signal. 

55. The downmixer of Claim 54, where the controller is further capable of generating at 
5 least one feedback constant responsive to at least one of the input and output channel energy, 

where the controller is capable of generating at least one of the mix coeflficients responsive to 
the at least one feedback constant. 

56. The downmixer of Claim 55, where the controller being capable of determining the 
10 input and output energy includes the controller being capable of determining the input and 

output energy over a first time period. 



57. The downmixer of Claim 56 where the controller being capable of determining the at 
least one feedback constant includes the controller being capable of averaging the at least one 

15 feedback constant over a second time period. 

58. The downmbcer of Claim 57, where the controller being capable of generating at least 
one mix coefficient includes the controller being capable of averaging at least one of the 
generated mix coefficients over the second time period. 

20 

59. The downmixer of Claim 57, where the second time constant includes multiple 
iterations of the first time constant. 



60. The downmixer of Claim 54, where the controller determining at least one of the 
25 input and output energy includes the controller being capable of filtering at least one of the 
input and the output energy, where the controller being capable of generating the at least one 
mix coefficients includes generating at least one of the mix coefificients responsive to the at 
least one filtered input and output energy, 

30 61. The downmixer of Claim 53, where the controller being capable of generating at least 
one mix coefficient includes the controller being capable of generating at least one of a left 
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front channel mix coefficient, a right front channel mix coefficient, a left surround channel 
mix coefficient, and a right surround channel mix coefficient. 

62. The downmixer of Claim 53, where the controller is further capable of downmixing 
5 the plurality of input channels of the input signal to the number of channels of the output 

signal responsive to the at least one generated mix coefficient. 

63. The downmixer of Claim 53, where tfie number of input channels of the input signal 
is one of 3, 5, 5.1 and 7. 

10 

64. The downmixer of Claim 63, where the number of output channels of the output 
signal is 2. 

65. The downmixer of Claim 53, where the controller being capable of generatmg at least 
15 one mix coefficient includes the controller being capable of generating at least one mix 

coefficient by adjusting a mix coefficient determined in accordance with a Sine/Cosine pan 
law. 

66. The downmixer of Claim 53, where the controller being capable of generating at least 
20 one mix coefficient includes the controller being capable of limiting an upper value of and a 

lower value of at least one of the generated mix coefficients. 

67. The downmixer of Claim 53, further comprising: 
a storage device coupled with the controller; 

25 where the controller being capable of generating at least one mix coefficient includes 

the controller being capable of retrieving at least one mix coefficient from the storage device 
responsive to the input channel energy. 

68. The downmixer of Claim 67, further comprising: 

30 the controller being capable of determining at least one of a front left, front center and 

front right input channels of the input signal; 
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the controller being capable of retrieving the at least one mix coefficient includes 
retrieving at least one mix coefficient responsive to a panning angle between at least one of a 
front left and front center input channel, and a front right and front center input channel. 

5 69. The downmixer of Claim 53, where the plurality of input channels is equal in number 
to the plurality of output channels. 

70. The downmixer of Claim 53, where the plurality of input channels is greater in 
number than the plurality of output channels. 

10 

71. A downmixer for generating mix coefficients for downmixing a multichannel input 
signal having a plurality of input channels, to an output signal having a plurality of output 
channels, comprising: 

means for determining an input energy at a plurality of input channels of the input 
15 signal; and 

means for generating at least one mix coefficient responsive to the input energy where 
the input signal energy, and the apparent direction of the input signal are substantially 
preserved in the output signal. 

20 72. The downmixer of Claim 71, further comprising: 

means for determining an output energy for at least one of the output channels; 
where the means for generatmg at least one mix coefficient generates at least one mix 
coefficient responsive to the input energy and the energy, where the input signal energy, and 
the apparent direction of the input signal are substantially preserved in the output signal. 

25 

73. The dovramixer of Claim 72, further comprising: 

means for generating a feedback constant responsive to the input and output energy; 

where the means for generating at least one mix coefficient generates at least one mix 
coefficient responsive to the feedback constant. 
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74. A storage media for use on a processor of a downmixer, the downmixer for generating 
mix coefficients for downmixing a multichannel input signal having a plurality of input 
channels, to an output signal having a plurality of output channels, comprising: 

a first memory portion programmed for determining an input energy at a plurality of 
mput channels of the input signal; and 

a second memory portion programmed for generating at least one mix coefficient 
responsive to the input energy, where the input signal energy, and the apparent direction of 
the input signal, are substantially preserved in the output signal. 

75. The storage media of Claim 74, further comprising: 

a third memory portion programmed for determining an output energy for at least one 
of the output channels; 

where the second memory portion being programmed for generating at least one mix 
coefficient includes generating at least one mix coefficient responsive to the input energy and 
the energy, such that the input signal energy, and the apparent direction of the input signal are 
substantially preserved in the output signal. 

76. The storage media of Claim 75, further comprising: 

a fourth memory portion programmed for generating a feedback constant responsive 
to the input and output energy; 

where the second memory portion being programmed for generating at least one mix 
coefficient includes generating at least one mix coefficient responsive to the feedback 
constant. 

77. A method of generating mix coefficients for downmixing a multi-channel input signal 
having a plurality of input channels, to an output signal having a plurality of output channels, 
comprising: 

determining an input energy at a plurality of input channels of the input signal; and 
generating at least one mix coefficient responsive to the input energy. 

78. The method of Claim 77, further including detecting a beginning of a sound event in 
at least one of the input channels, where generating at least one mix coefficient includes 
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generating at least one mix coefficient responsive to the first input energy and ttie detected 
beginning of the sound event. 

79. The method of Claim 78, where the determining an input energy includes: 
5 determining a first input energy for at least one of the input channels; and 

determining a second input energy for at least another of the input channels; 

where the generating at least one mix coefficient includes generating at least one mix 
coefficient responsive to the first input energy, second input energy, and the detected 
beginning of tiie sound event. 

10 

80. The method of Claim 79, further comprising: 

determining an energy ratio of the first and second input energy; 
where the generating at least one mix coefficient includes generating at least one mix 
coefficient responsive to the energy ratio and tiie detected beginning of the sound event. 

15 

81. The method of Claim 77, where the generating at least one mix coefficient includes 
generating at least one mix coefficient responsive to the input energy where the apparent 
direction of the input signal is substantially preserved at the output signal. 

20 82. The method of Claim 77, where the plurality of input channels is equal in number to 
the plurality of output channels. 

83. The method of Claim 77, where the plurality of input channels is greater in number 
than the plurality of output channels. 

25 

84. The method of Claim 77, where the generating at least one mix coefficient includes 
increasing a value of at least one mix coefficient. 

85. A downmixer for downmixing a multichannel input signal including a plurality of 
30 input channels to an output signal including a plurality of output channels, comprising: 

an input signal source for receiving at least one of the input channels of the input 

signal; 
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a controller coupled with the input signal source, capable of 

determining an input energy at a plurality of input channels of the input signal, 
detecting a beginning of a sound event in at least one of the input channels; 

and 

5 generating at least one mix coefficient responsive to the input energy and the 

detected beginning of the sound event. 

86. The downmixer of Claim 85, where the controller being capable of generating at least 
one mix coefficient includes the controller being capable of increasing a value of at least one 

10 mix coefficient. 

87. The downmixer of Claim 85, where the controller being capable of determining an 
input energy includes the controller being capable of: 

determining a first input energy for at least one of the input channels; and 
15 determining a second input energy for at least another of the input channels; 

where the generating at least one mix coefficient includes generating at least one mix 
coefficient responsive to the first input energy, second input energy, and the detected 
beginning of the sound event. 

20 88. The downmixer of Claim 87, further comprising the controller being capable of: 
determining an energy ratio of the first and second input energy; 
where the generating at least one mix coefficient includes generating at least one mix 
coefficient responsive to the energy ratio and the detected beginning of the sound event. 

25 89. The downmixer of Claim 85, where the the controller being capable of generating at 
least one mix coefficient includes generating at least one mix coefficient responsive to the 
input energy and the detected beginning of the sound event where the apparent direction of 
the input signal is substantially preserved at the output signal. 

30 90. The downmixer of Claim 85, where the plurality of input channels is equal in number 
to the plurality of output channels. 
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91. The downmixer of Claim 85, where the plurality of input channels is greater in 
number than the plurality of output channels. 



53 



INSDOCIO: <1,VO 03G94369A2_L> 



wo 03/094369 



PCT/US03/13693 




.03C34389A2lL> 



1/13 



wo 03/094369 



PCTAJS03/13693 



Receiving l/P Channel 
Infonnation 



Generating Mix Coefficient(s) 



-200 



-202 



204 



206 



I. 



Mixing LI and CI 
Channels 



1 



Mixing Rl and CI 
Channels 



Providing Any 
Desired Phase Shift 
To L' Channel 



T 



I. 



Providing Any 
Desired Phase Shift 
To R' Channel 



-208 



-210 



J 



Providing O/P Channel 
Information LO, RO 



-212 



Figure 2 



Determining At Least One Of l/P 
And O/P Channel Energy 



Determining Feedback 
Constant(s) 



Generating Mix Coefricient(s) 
Figure 3 



-300 



-302 



-304 



2/13 



INSDOCID: <VVO ^03094363A2J_> 



wo 03/094369 



PCTAJS03/13693 



Receiving l/P Channel 
Infomnation LI , CI, Rl 



Filtering l/P Channel 
Information To Form Limited- 
Bandwidth l/P Channel 

Information Llj^j^.d^,.^, Rl^,^ 



400 



402 



Determining Limited-Bandwidth 
Input Channel Energy ELly^ 
And ERI. 



Lim 



404 



Determining Linriited-Bandwidth 
Output Channel Information 
LO^AndROL^ 



J. 



-406 



Determining Limited-Bandwidth 
Output Channel Energy ELOl,^ 
And ERO, 



Lim 



408 



410 



Averaging Limited-Bandwidth l/P And O/ 
P Channel Energy as 



EUsum. ERIs„^. ELOs.™. ERO; 



'Sum 



Sum' 



Sum 



NO 




412 



Determining Total Limited-Bandwidth 
l/P And O/P Channel Energy 
EINL^. EINRu,. EOUTL^. EOUTR^^ 



414 



Figure 4 



3/13 



wo 03/094369 PCT/US03/13693 



500 



504 




Generating Feedback Constant As 
fbl = .98*fbl + gfl5((EOUTL^/EINLLj„) -1) 



502 



Generating Feedbacl< Constant As 
fbl = .98*fbl 




510 



Generating Feedback Constant As 
fbr = .98*fbr + gfb((EOUTRLj„/EINRLi„) -1) 



508 



Generating Feedback Constant As 
fbr = .98*fbr 



Figure 5 



3NSDOCID: <WO ^03t»43S9A%_l_> 



4/13 



wo 03/094369 



PCT/US03/13693 



Generating ml' 



Limiting mr Values 



Generating mr* 



Limiting mr' Values 



'600 
^602 

'604 

^606 

^608 



Updating Mix Coefficients 



Figure 6 



Mix 
Coefficient 
Values 




100 



Panning Angle 



Figure 7 



5/13 



BNSOOaO: <VVO 030943^A2J_> 



wo 03/094369 



PCT/US03/13693 



Mix 
Coefficient 
Values 




10 20 30 

Panning Angle 



40 



50 



Figure 8 



PiSDOCID: <VVO ^03094369A2J_> 



6/13 



wo 03/094369 



PCT/US03/13693 




wo 03/094369 



PCT/US03/13693 



Receiving l/P Channel 
Infomiation 



Generating Mix Coefficient(s) 



I 



1000 



1002 



1004- 



1006- 



1008- 



IVIixing LI. CI. LFE 
and Rl Channels 



Adding Component 
Of RSI And LSI To 
One Another 



Adding Components 
of LSI and RSI 
Channels 



1 



Multiplying By 
Respective Mix 
Coefficient 



Providing Any 
Desired Phase Shift 
For Front Channels 



Providing Any Desired 
Phase Shift For 
Surround Channels 



1010 



1012 



1014 



Mixing Front Channels and 
Surround Channels 



Providing O/P Channel 
Information LO, RO 



1016 



1018 



Figure 10 



INSI^CtO: <V.O 03S343fi9A2_!_> 



8/13 



wo 03/094369 



PCT/US03/13693 



Receiving UP Channel Information 
LSI And RSI 



1100 



Filtering l/P Channel Information To Fomi 
Limited-Bandwidth l/P Channel 
Information LSI^.^ And RSI^^^ 



1102 



Detemriining Limited-Bandwidth O/P Channel 

Information 
LSO-ReL-^. LSO-lmL^. RSO-ReL^.RSO-lm., 



Um 



-1104 



Determining Limited-Bandwidth l/P Channel Energy 
ELSI^. ERSI^,, 



Determining Limited-Bandwidth Output Channel Energy 
ELSO-Re^j^, ELSO-lmL,^. ERSO-Re^,. ERSO-lm^^ 



Averaging Limited-Bandwidth l/P And O/P Channel 
Energy as 
ELSIsu.. ERSl3„^. 
ELSO-Res„„. ELSO-lnig^^. ERSO-Res„„. ERSO-lm. 



Sum 



NO 




1112 



Determining Total Limited-Bandwidth 
l/P And O/P Channel Energy 
E'numAndEOutLj^ 



1114 



1106 



1108 



1110 



Figure 1 1 



9/13 



wo 03/094369 



PCT/US03/13693 



Filtering Limited-Bandwidth l/P 
And O/P Energy 



Determining Feedbacl< Constant 
fbsi 



-1200 



-1202 



Figure 12 



1302 



1304 



-1300 




mi'= 1 



1310 



Setting mi' = 0 
where mi' is < 0 



Updating Mix Coefficients 



-1312 



Figure 13 



10/13 



INSD0C:D: -rtVO ^03a94369A2_l_> 



wo 03/094369 



PCT/US03/13693 



Determining l/P Channel Energy 



Adjusting Mix Coefficient(s) 



1400 



-1402 



Figure 14 



Receiving l/P Channel 
Information LI. Rl, CI, LSI And RSI 



Determining Front Input Channel 
Energy ELI. ECl, And ERI 



Determining Total Front Input Channel 
Energy EFI 



Determining Surround Input Channel 
Energy ELSI And ERSI 



Determining Total Surround Input 
Channel Energy ESI 



Averaging Front And Surround Input 
Channel Energy As EFIs„^ And ESIg^^ 



-1500 



-1502 



-1504 



-1506 



-1508 



1510 



1512 




Filtering Front and Sunround Input 
Channel Averages As 
EF'um. ESI,,, 



-1614 



Figure 15 

11/13 



BNSDC^ID: <AVO ^030943S3A2_L> 



wo 03/094369 



PCT/US03/13693 



Generating Surround 
Energy Boost Factor 



-1600 



1602 




1604 



Averaging ESIg^^ Using 
First Time Constant 



Averaging ESIg^^ Using 
Second Time Constant 



Determining A F/S 
Energy Ratio 



-1608 



1610 




1616 



ms' = .71*ms' 
i 



mi" = .71*mi' 



-1612 



-1614 




ms* = 0.8 -0.045* (F/S - 2) 





NO 




r 


ms'= 1 -0.2*(F/S- 1) 



mi' = 0.8 -0.045* (F/S - 2) 



-1618 



-1620 



mi' = 1 -0.=2*(F/S-1) 



1622 



-1624 



Figure 16 



12/13 



.03094369A2_L> 



wo 03/094369 



PCT/US03/13693 



Generating Rear 
Surround Input Energy 
Ratio S/l 




SBF = 0.97SBF + 0.03 S/l 




Figure 17 



13/13 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World InteUectual Property 
Organization 
International Bureau 

(43) International Publication Date 
13 November 2003 (13.11.2003) 




(10) International Publication Number 

PCX wo 2003/094369 A3 



(51) International Patent ClasslGcation^: 
(21) International Application Number: 



H04B 1/00 



PCT/US2003/0 13693 
2 May 2003 (02.05.2003) 

English 
English 



US 



(22) International Filing Date: 

(25) Filing Language: 

(26) Publication Language: 

(30) Priority Data: 

60/377,661 3 May 2002 (03.05.2002) 

(71) Applicant: UARMAN INTERNATIONAL INDUS- 
TRIES, INCORPORATED [US/US]; 8500 Balboa 
Boulevard, Northridge, CA 91329 (US). 

(72) Inventor: GRIESINGER, David, H.; 23 Bellevue Av- 
enue, Cambridge, MA 02140 (US). 

(74) Agent: BARENIE, Paul; Brinks Hofer Gilson & Lione, 
P.O. Box 10087, Chicago, IL 60610 (US). 



(81) Designated States (national)'. AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
C:Z, DE, DK, DM, DZ, EC, EE, ES, H, GB, GD, GE, GH, 
GM, HR, KU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NT, NO, NZ, OM, PH. PL, PT. RO, RU, SC, SD, 
SE, SG, SK, SL, TJ, TM, TN, TR, TT, TZ. UA, UG, UZ, 
VC, VN, YU, ZA, ZM, ZW. 

(84) Designated Stetes (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), 
Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), 
European patent (AT, BE, BG, CH, CY, CZ, DE, DK, EE, 
ES, FI, FR, GB, GR, HU. IE, IT, LU, MC, NL, PT. RO. 
SE, SI, SK, TR), OAPl patent (BF, BJ, CF, CG, CI. CM. 
GA. GN. GQ, GW, ML. MR, NE, SN, TD. TG). 



Published: 

— with imemationai search report 



f Continued on next page] 



(54) Title: MULTI-CHANNEL DOWNMIXING DEVICE 



102 



\ 



< 

On 




(57) Abstract: A method and system (100) are 
provided for generating one or more mix coeffi- 
cients (ml, mr) for downmixing a multichannel 
input signal having a plurality of input channels 
(LI, CI, RI), to an output signal having a plural- 
ity of output channels (LO, RO). Mix coeflicients 
may be generated responsive to a comparison of 
energy between the downmixed (output) signal 
and the input signal to the downmixer ( 1 00). such 
that energy and intended direction of the input 
signal are substantially preserved in the output 
signal. Further, the mix coefficient generation 
may preserve an intended direction of an input 
signal, for example, received at a surround input 
channel, in at least one output channel of the out- 
put signal. The mix coefficient values (ml*, mr') 
may be generated in a test downmixter (104) en- 
vironment Additionally . one or more mix coef- 
ficients may be generated by retrieving predeter- 
mined mix coefficient values. 



/ 



100 



JNSI^:iI>- <WO ^03(m389A3_l_> 



wo 2003/094369 A3 



lilllilllilillillliillillllllilililiilllilliDU 



(88) Date of publication of the international search report: 

25 March 2004 



For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



rNSDOCID: <WO ^030943S9A3_L> 



INTERNATIONAL SEARCH REPORT 


International application No. 




PCT/US03/13693 


A. CLASSmCATION OF SUBJECT MATTER 




IPC(7) : H(WB 1/00 




USCL : 381/119 




AccorcfinE to International Patent Classincation OPC) or to both national classification and IPC 


Is. Fil^Llls SEARCHED 



Minimi Tm documentation searched (classification system followed by classificadon symbols) 
U.S. : 381/119. I. 17. 22. 23. 27. 61. 307; 369/174; 704/500. 503; 455/313 



Dbcumenlation searched other than minimum documentatian to die extrait that sack documents are included in the fields searched 



Electronic data base consulted 
Please See Continuation Sheet 



during tbe international search (name of data base and, \ivbere practicable, searcdi terms used) 



DOCUMENTS CONSIDERED TO BE RH^ANT 



Category = 



A 
A 
A 
A 



Citation of document, with indjcation, wdiere q>prqpriaiB. of the relevant passages 



US 6,141.645 A (Cffl-MIN et al.) 31 October 2000 (31.10.2000). see entire docucment 
US 5,870,480 A (GRIESINGER) 09 February 1999 (02.09. 1999). see entire document 
US 5,610,986 A (MILES) U March 1997 (11.03.1997). see entire document 
US 5.594,800 A (GERZON) 14 January 1997 (14.01. 1997). see entke document 



Relevant to claim No. 



1-91 
1-91 
1-91 
1-91 



□ 

Further documents are listed in the continuation of Box C, Q 



See patent family annex. 



* Special categoncs of atcddocumeiiu: -T" Utter document published after the imematiooal ffling date or priority 
«... J ^ . ^ not in. cGoflict wUh the smpUcatloa but cited toundastand the 
-A- document definmE the general state of the art viAichU not ccnildered to be principle or theory underlyinc thetovenUoo 
of particular relevance ' *" 

-CI. -I- 1* • ....... * docomem of paiticnlar rdevance; the claimed invention cannot be 

E eartier appQcation or patent published en or after the imematioDal filing date considered novel or cannot be considered to involve an inventive step 
, . ... ^ ^ when tbe document is tatoen alone 

L" nocnrnrnf wnlcfa mqr throw doubts oo prioriiy cUdin(s) at v/tiich h cited to 

estab^lhe pubBcatioa date of another dtation or other special reason (as "Y" docmnem of particular relevance; die claimed mvemioo cannot be 

spcaueo) considered to involve an inventive step when the dociutient is 

J r ■ ..... combined with one or mere other such documems, sittb combinaiioa 

-u docimient reTerruig to an oral disdosnre, use, exhibition or other means being obvious to a peiscn skiUed in the art 

■P" document published prior to the liiteixiatiaDal fliing date bm later than the doeamem member of tbe same patent family 
pnori^ date cUdmed r— — ^ 


Date of the actual conqiletion of the international search 

15 September 2003 (15.09.2003) 


Date of mailing of the international search Tepott 

1 4 OCT 7nitll ' 


Name and mailing address of the ISA/US 
MaU Stop PCT, Atm: ISA/US 
Commissioaer for Patents 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
Facsimile No. (703)305-3230 


Authorized officer 

ConP. Trau \J " ^^Jtl/f^jt^ 
Telephone No. "y^jf^ 



B^:S0CK^:0: <V.'0_ ^C31»»3S9A3_I_> 



INTERNATIONAL SEARCH REPORT 



PCTAJS03/ 13693 



Continuation of B. FIELDS SEARCHED Item 3: 

USPAT. US-PGPUB.EPO. JPO. DERWENT. IBM_TDB, DEEE 3^1ore, Goo^e. Citeseer. 

search Cemis: dovuDmixer, mixer, modulator, feedback, surround, coefBcient, energy, bandwidth, Sine/CosiiiB pan law. 



Fonn PCT/ISA/210 (second sheet) (July 1998) 



tKSOOCID: <VVO (^094389A3_I_> 



